Administration

AI Checks

Available for

  • Phrase TMS (API support)

  • UI access available upon request

Get in touch with Sales or your Customer Success Manager for licensing questions and UI access requests.

Note

AI checks replace the previous quality profiles experience. Quality profiles are no longer created or selected manually; Phrase assigns one automatically based on the project's content group.

Quality profiles will be deprecated on October 12, 2026.

AI checks are automated checks that run during quality evaluation. Each AI check comes from a rule and returns a true or false verdict for the content it checks.

Phrase creates AI checks from rules automatically, not by hand. Managing rules manages AI checks.

Everything is matched by content group and language. A project belongs to one content group, and each job has a language. When quality evaluation runs on a job, Phrase applies the AI checks for that job's content group and language automatically, with no separate step to add or select checks per project.

AI Check Origin

AI checks come from rules, never from scratch. Phrase creates one AI check from each eligible rule, a one-to-one mapping. Because every check comes from a rule, managing rules decides which checks run:

  • Disabling a rule disables its AI check, so quality evaluation skips it.

  • Re-enabling a rule does not automatically re-enable its AI check.

  • Deleting a rule deletes its AI check.

Rules are the single source of truth and AI checks always follow them, so guidance and checks cannot drift apart.

When pre-translation uses a capability that does not apply rules, for example, Phrase Next GenMT instead of AI Translation Agent, AI checks still require rules first. Checks always come from rules; no standalone AI check exists.

Permissions

  • Only Platform Administrators and Owners can manage the rules that produce AI checks.

  • Platform members (for example, TMS Linguists) can view the checks that apply to their content. They cannot change them.

Viewing AI Checks in the UI

AI checks are generated and assigned automatically. The checks that apply to any content group, and the reasons behind them, are always visible.

  1. From Dashboard, click Content groups.

  2. Select the content group to view its AI checks.

  3. Open the Quality profiles tab. AI checks that run during quality evaluation for this group, grouped by language, are displayed.

Each AI check shows the rule it came from, the content group(s) and language(s) it applies to, and its status.

Turning a Check On or Off

AI Checks are not toggled directly. Manage a check through its rule on the Rules tab. Disabling the rule disables its check.

Omitted Checks

Not every rule can become a check. When Phrase cannot create an AI Check from a rule, it skips the check and shows the reason, so it is always clear why a guideline is not verified automatically.

Omitted checks appear with an Omitted badge and the reason for omission. They stay disabled and do not run during quality evaluation.

AI Checks, Rules, and Quality Profiles

These represent three views of one model:

  • Rules define how content should be written. AI capabilities apply rules during translation, and rules serve as the source of truth for language guidelines.

  • AI checks are the checkable form of rules applied during quality evaluation.

  • A quality profile is the full set of AI checks for one content group. It matches a content group one-to-one, and Phrase assigns it automatically.

Adding, editing, enabling, disabling, or reusing the checks in a quality profile happens through the rules behind them.

Limits

  • A maximum of 20 AI checks apply to one content group and language combination.

Was this article helpful?

Sorry about that! In what way was it not helpful?

The article didn’t address my problem.
I couldn’t understand the article.
The feature doesn’t do what I need.
Other reason.

Note that feedback is provided anonymously so we aren't able to reply to questions.
If you'd like to ask a question, submit a request to our Support team.
Thank you for your feedback.