Skip to main content

​
Quality Evaluator API Reference 1.0.0

The Quality Evaluator API uses LLMs to automatically assess translation quality against requirements you define — in plain language, not fixed rule sets. It scales the kind of review a human linguist would do: check tone, terminology, formatting, and custom requirements across any volume of segments. Quality requirements are managed as Style Guide Rules attached to a Content Group. Link evaluation to the Content Group and the API resolves its active Rules into AI Checks automatically — no separate profile to create or keep in sync.

​
Key Features

  • Content Group integration: Quality requirements stay in sync with Style Guide Rules without manual profile maintenance
  • AI Checks: Rules are resolved into checks defined in natural language (e.g., “Translation must not use Yoda-style speech”)
  • Analytics: Track evaluation metrics and AI unit consumption over time

​
Base URLs

The Quality Evaluator API is available in multiple regions:
RegionBase URL
EUhttps://eu.phrase.com/quality-evaluator
UShttps://us.phrase.com/quality-evaluator

​
Quick Start

  1. Attach Style Guide Rules to your Content Group (with AI Check support enabled)
  2. Evaluate segments by referencing the Content Group — checks are resolved automatically
# Example: Evaluate segments against a Content Group's resolved AI Checks
curl -X POST "https://eu.phrase.com/quality-evaluator/v3/evaluation" \
  -H "Authorization: Bearer YOUR_JWT_TOKEN" \
  -H "Content-Type: application/json" \
  -d '{
    "contentGroupId": "cg-abc123",
    "segments": [
      {
        "id": "seg-1",
        "source": "Hello, world!",
        "target": "Hallo, Welt!"
      }
    ],
    "sourceLocaleCode": "en_us",
    "targetLocaleCode": "de_de"
  }'