CAT Editors

LQA Assessments (TMS)

Content is machine translated from English by Phrase Language AI.

Available for

  • Ultimate and Enterprise plans (Legacy)

Get in touch with Sales for licensing questions.

Only available in workflow steps in which LQA is enabled.

When assessing content quality, different rules may be required for different content types or clients. Some content may need to have precise terminology and others may need to follow locale convention or be precise with target length and markup. Errors may also require different severities or assigned weights.

Overall feedback cannot be provided for joined jobs.

Add an LQA Assessment

To add an assessment, follow these steps:

  1. Select the LQA pane LQA_pane.png and click Start assessment.

  2. Select a segment.

    • To assess a particular piece of text, select the text inside the segment.

  3. Click the flag icon lqa_flag.pngnext to the segment to open the Error category drop-down list. 

  4. Select an Error categorySeverity, if the issue is a repeated one and an optional description. 

    Optionally, type or select @ to add a mention in the description and select the desired user or group of users from the list. Mentioned user(s) receive an in-app notification.

  5. Click Flag issue.

    LQA assessment is added and can be edited, replied to or deleted from the ellipses.png menu.

    • Replying to LQA assessments allows to add a mention by typing or clicking @ and selecting the desired user or group of users from the list. Mentioned user(s) receive an in-app notification.

  6. Repeat the last two steps to add more assessments.

  7. Click Finish LQA.

    Assessments are added to the LQA tab.

Segments with LQA assessments are identified with a solid flag icon solid_lqa_flag.png. Created assessments can be edited or deleted from the ellipses menu of a specific assessment ellipses.png (not available for assessments created by others).

Add Bulk Assessments

Assessments can be added to a selection of segments at the same time with a limit of 500 segments. The initial assessment is considered the parent Parent_comment.jpg in a selection with the following assessments being the children Child_comment.jpg. Editing or deleting these selections can then be performed in bulk operations instead of as individual assessments.

Relations in bulked assessments

  • Editing or replying to a child assessment severs the relation to the parent assessment (bulk operations can no longer be performed).

  • Replying to a parent assessment does not break the relation to the children and replies are not propagated to the children.

  • Edits to a parent can be optionally applied to only the parent or to the children as well.

  • Deleting a parent severs the relation between the children (bulk operations can no longer be performed).

To add bulk assessments, follow these steps:

  1. With the LQA pane displayed, select a number of segments for flagging with an issue.

    The selected segments numbers will be indicated in the New issue window.

  2. Select an Error categorySeverity, if the issue is a repeated one and optionally provide a description. 

  3. Select how the issue should be flagged in the selected segments:

    • Flag issue in subsequent segments as repeated issue.

    • Flag issue in all segments as non-repeated issue.

      Repeated issues do not have this option.

  4. Click Flag issue.

    The issue is added to the specified segments with the parent issue indicated with Parent_comment.jpg and the children indicated with Child_comment.jpg. Click the child icon to be taken to the parent issue.

Listed issues can be filtered Issue_filter.jpg. Options can be combined and include filtering by severity or Only repeated issues and Only parent issues.

Scoring of bulked assessments

Repeated issue unchecked with Flag issue in subsequent segments as a repeated issue.

Repeated issue unchecked with Flag issue in all segments as non-repeated issue.

Repeated issue checked with Flag issue in subsequent segments as a repeated issue.

Segment 1

Unique error - penalty added (parent issue)

Unique error - penalty added

Repeated error - no penalty added

Segment 2

Repeated error - no penalty added

Unique error - penalty added

Repeated error - no penalty added

Segment 3

Repeated error - no penalty added

Unique error - penalty added

Repeated error - no penalty added

LQA Assessments

To generate the LQA assessment, click Finish in the LQA tab. Overall feedback can be optionally applied.

A score will be calculated and a result will be displayed based on the pass/fail threshold set in the LQA profile. The score and the result are displayed in the LQA tab and on the jobs table in the LQA score column if LQA is enabled for that workflow step.

The score is calculated from the job's total word count.

Scoring example:

A text of 500 words is set to fail LQA when it contains 1 critical Accuracy error and 1 minor Grammar error. The Accuracy error is given a weight of 2.0 and Grammar a weight of 1.0. Critical severity is penalized with 10 points and minor severity with 1 penalty point.

  1. Count the number of issues for each error category and multiply by respective severity weight and error weight:

    • Accuracy penalties = number of critical errors x critical error penalty x accuracy weight = 1 x 10 x 2.0 = 20 penalty points

    • Grammar penalties = number of minor errors x minor error penalty x grammar weight = 1 x 1 x 1.0 = 1 penalty point

  2. Add up the penalties:

    • Penalty total = Accuracy penalties + Grammar penalties = 20 + 1 = 21

  3. Calculate the pass/fail score, using the MQM scoring model [Score = 1 - Penalty total/Wordcount]:

    • Score = 1 - Penalty total/Wordcount = 1 - 21/500 = 0.958

  4. Present the score result as a percentage:

    • Score % = 0.958 x 100 = 95.8

  5. Enter Score % as your pass/fail threshold:

    • Your pass/fail threshold is 95.8 %

Clicking on the results in the jobs table opens a scorecard window with options to send the scorecard by email or export as a spreadsheet (.XLXS) file. The link to download the LQA scorecard received via email expires after 5 days. Right-click on more than one selected job to have the option to download multiple scorecards.

Assess a Repetition

Assessments can be added to repetitions with different flagging options with a limit of 500 segments.

To assess a repetition, follow these steps:

  1. With the LQA pane displayed, select a repetition for flagging with an issue.

    Repetitions following the selected one can be flagged together.

  2. Select an Error categorySeverity, if the issue is a repeated one and optionally provide a description. 

  3. Select how the repetition is to be flagged:

    • Flag issue in subsequent repetitions as repeated issue

    • Flag issue in all repetitions as non-repeated issue

      If the issue has been indicated as a repeated one, this option is not available.

    • Flag issue in this segment only

      Subsequent or previous repetitions can be flagged independently.

  4. Click Flag issue.

    The issue is added to the specified segments with the parent issue indicated with Parent_comment.jpg and the children indicated with Child_comment.jpg. Click the child icon to be taken to the parent issue.

Listed issues can be filtered Issue_filter.jpg. Options can be combined and include filtering by severity or Only repeated issues and Only parent issues.

Editing or deleting the parent issue gives options for whether the command should be applied to only the parent issue or to all issues created in bulk, including the children. Editing or deleting a child issue only applies the command to the selected issue.

Repeating LQA issues may require different treatment and may be:

  • Flagged as repeating and excepting the parent issue do not add any penalty points to the final LQA score.

  • Flagged as a unique issues adding penalty points to the final LQA score with subsequent issues being unique as well and reflected in the score.

Scoring of repeated segments

Repeated issue unchecked with Flag issue in subsequent segments as a repeated issue.

Repeated issue unchecked with Flag issue in all segments as non-repeated issue.

Repeated issue unchecked with Flag issue in this segment only

Repeated issue checked with Flag issue in subsequent segments as a repeated issue.

Repeated issue checked with Flag issue in this segment only

Repetition 1

Unique error - penalty added (parent issue)

Unique error - penalty added

Unique error - penalty added

Repeated error - no penalty added

Repeated error - no penalty added

Repetition 2

Repeated error - no penalty added

Unique error - penalty added

No error logged

Repeated error - no penalty added

No error logged

Repetition 3

Repeated error - no penalty added

Unique error - penalty added

No error logged

Repeated error - no penalty added

No error logged

Was this article helpful?

Sorry about that! In what way was it not helpful?

The article didn’t address my problem.
I couldn’t understand the article.
The feature doesn’t do what I need.
Other reason.

Note that feedback is provided anonymously so we aren't able to reply to questions.
If you'd like to ask a question, submit a request to our Support team.
Thank you for your feedback.