- Perform side-by-side comparisons of AI-generated responses and determine which response is stronger.
- Evaluate responses for factual accuracy, relevance, completeness, clarity, reasoning, instruction-following, tone, and overall quality.
- Assess content written in English, French, or a combination of both.
- Apply French expertise when evaluating language, terminology, tone, regional conventions, idioms, and cultural context specific to France.
- Identify subtle differences between responses, including unsupported claims, incomplete reasoning, and unnatural phrasing.
- Apply detailed, scenario-specific annotation guidelines accurately and consistently.
- Document decisions clearly and provide concise, evidence-based rationale.
- Participate in training, guided practice, calibration sessions, and qualification reviews.
Analytical SkillsCritical thinking