-
Team, Professional, Business, Enterprise and Software UI/UX plans
Get in touch with Sales for licensing questions.
Quality profiles allow organizations to define consistent, AI-driven quality checks for multilingual content.
A Quality profile defines up to three AI checks that include specific review criteria for the AI to evaluate segment quality. Review criteria instruct the AI on what to look for in the translated segments to determine whether they meet the quality standards.
Quality evaluation is enforced in Phrase TMS during pre-translation and can be applied once per job at project or project template level. During pre-translation, segments are evaluated according to the selected profile. If a segment passes all AI checks, it is automatically locked. If it does not, it remains editable and the detected issues can be reviewed in the CAT web editor.
Availability and AI Usage
Quality profiles are not enabled by default. To use the feature, the organization must:
-
Have an active Phrase Platform subscription that includes AI Units (AIUs).
-
Request access to enable the feature. Select in the left navigation menu of the Phrase Platform to unlock the feature.
Only Platform Administrators and Owners can request access.
Each AI check evaluation consumes AI Units. When converting words into AIUs, both target words and review criteria words are counted.
Limits
-
Up to three AI checks can be added to any Quality profile.
-
Review criteria can contain maximum 2000 characters.
-
Quality profiles are executed once per job during pre-translation. If the job was not automatically pre-translated on job import, quality evaluation can be triggered later via manual pre-translation from the project list page. If manually triggered, quality evaluation is limited to the first workflow step.
-
Profiles must be created in the page before they can be selected in pre-translation settings.
Permissions
-
Only Platform Owners and Administrators can configure Quality profiles and access the tab in the page.
-
TMS Project Managers can apply Quality profiles to pre‑translation.
-
TMS Linguists can only view quality evaluation results in the CAT web editor.
After access is enabled, Quality profiles and AI checks can be created and managed in the page of the Phrase Platform that is accessible by selecting Quality profiles in the left navigation menu.
Create Quality Profiles
To create a Quality profile, follow these steps:
-
Click New Quality profile.
The page is displayed.
-
Click Edit to change the profile name and Save it.
Tip
The profile name does not need to be unique. It is recommended to choose a name that reflects the content type and/or target language it applies to. Note that there is no automatic matching between language-specific Quality profiles and language pairs in a project.
-
Click Add AI Check to configure the AI checks for the new profile:
-
Select Create new to create a new AI check in the section.
-
Select Add existing to find and add existing AI checks from the side panel.
-
-
Repeat step 3 until all desired checks have been added, then click Create profile at the top right of the page.
The new profile appears in the Quality profiles list.
Create and Test AI Checks
To create a new AI check, follow these steps:
-
When adding an AI check in new or existing profiles, choose Create new.
The section is displayed.
-
Provide a .
The AI check name does not have to be unique, but it should be descriptive enough to differentiate it.
-
Enter .
Optionally, click View examples to see and use predefined templates.
-
Click Test AI Check to expand the relevant section and validate the AI check before saving.
-
Selecte the desired and , then enter source and target text.
Tip
The should intentionally contain errors that violate the review criteria.
-
Click Run test.
The AI evaluates the target text according to the review criteria and displays detected issues in the section.
If the AI does not find the expected issues, refine the review criteria and retest.
-
To test additional languages with the same criteria, click Add language and repeat steps 5 and 6.
-
Click Save check to add it to the Quality profile.
The check becomes available for reuse in other profiles.
Best Practices for Review Criteria
Review criteria determine the effectiveness of an AI check.
Multiple criteria can be included in a single AI check and can be grouped by theme (e.g., tone and terminology) or mixed within a single check. Both approaches are valid as long as instructions are not contradictory. Instructions can include rules applicable only to specific target languages.
Best practices include:
-
Specify content type and tone (for example, technical, marketing, legal; formal or persuasive).
-
List aspects to evaluate, such as terminology usage, style, clarity, structure, or brand voice.
-
Avoid ambiguity and vague terms.
-
Limit criteria to the most important requirements. Avoid overloading the AI with too many requirements. If needed, create separate checks for different criteria.
-
Use templates provided in the UI as starting points.
-
Refine criteria progressively. Start with general guidance, then increase specificity or add examples if results are not accurate enough.
-
Example (general):
Follow locale standards for Czech currencies. -
Example (specific):
Define currency format, separators, or symbol placement. -
Example (with output):
Use '1 000,50 Kč' instead of 'CZK 1,000.50'.
-
-
Write criteria that can be evaluated at the segment level. Avoid rules that depend on context outside a single segment (e.g., first mention in a document or document structure such as titles or subtitles).
Manage Quality Profiles and AI Checks
Quality profiles and AI checks can be edited, removed or deleted. From the page, click on a listed profile to open the page:
-
Click Edit to change the name of the profile.
-
Use the section to change the assigned AI checks by removing existing checks or adding new ones.
-
For AI checks listed inside the profile:
-
Click Edit from the three dots
menu next to a check to update its name or review criteria.
-
Click Remove from profile from the three dots
-
Click Permanently delete from the three dots
-
Select Quality profile(s) in the page and click Delete to delete them. Deleting a profile does not delete its underlying AI checks.
Once Quality profiles are configured, they can be applied during pre-translation and reviewed in the CAT web editor.
To apply a Quality profile during pre-translation, follow these steps:
-
When creating or editing a project or project template, navigate to the settings.
-
Under , select .
-
Quality profile evaluation follows the locking sequence defined in pre-translation settings. It is applied only to segments that were not locked by previous steps (translation memory matches, non‑translatables, QPS score, etc.).
-
-
Choose a from the drop-down list.
-
Save the settings.
The Quality profile evaluates segments during pre-translation. If a segment passes all checks, it is automatically locked.
Quality profile evaluation only runs against translated segments. If a job has no translations, no evaluation results are generated.
If jobs were imported without automatic pre-translation, quality evaluation can be triggered manually from the project's job list. To run a manual quality evaluation, follow these steps:
-
Select the job(s) to evaluate.
Only jobs in the first workflow step are supported.
-
Click the Pre-translate.
-
From the dropdown menu, select .
The window is displayed.
-
Under , select and the desired to use for the evaluation.
-
Click Pre-translate to begin the process.
The system will evaluate all segments in the selected jobs that have not been previously locked, based on the criteria in the chosen Quality profile.
Review Results in the CAT Web Editor
After running pre-translation, open the job in the CAT web editor to review results.
Locked segments show a lock icon with a tooltip explaining that the segment was locked after passing quality evaluation review criteria.
For segments that did not pass quality evaluation and were not locked, use the Quality Assurance (QA) pane to understand why a segment failed and decide whether to revise the translation manually:
-
In the CAT web editor, select the QA pane.
-
Click the tab.
Quality profile warnings in the AI checks tab are separate from QA warnings. QA warnings appear in the QA checks tab when QA is run. Quality profile warnings only appear once segments have been pre-translated and evaluated.
Each failed AI check displays a description of the issue for review.
Note
Issues remain attached to a segment even if the segment is updated. They are removed only when a segment is split or joined.
Quality Profile Insights
The tab on the page, accessible from the Platform dashboard, provides an overview of how Quality profiles affect the organization workflow(s).
Metrics include:
-
Locked words percentage
The share of words automatically locked by Quality profiles out of the total words processed.
-
Total volume
The number of segments or words evaluated by Quality profiles.
-
The percentage of words automatically approved and locked by Quality profiles.
-
AI Units consumed
The total AIUs used by Quality profiles.
Use filters to analyze specific periods or Quality profiles. This information helps assess the effectiveness of the Quality profile configuration and manage AIU consumption.