Analytical Evaluator - AI Feedback
New
M
MercorAI evaluation
Remote eligibility restrictions: CanadaContract
Salary70 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Native English fluency required.
- Required Skills
- Analytical SkillsAttention to detailWritten communication
Requirements
- Demonstrate strong analytical skills.
- Use strong critical-reading skills to identify nuance, implicit meaning, and gaps in reasoning.
- Write clear, precise, and well-evidenced rationales.
- Work independently and follow detailed task guidelines.
- Exercise consistent and honest judgment, including the ability to give critical assessments.
- Apply structured evaluation guidelines accurately and with strict attention to detail.
- Work entirely without AI writing tools.
- Have native English fluency.
- A bachelor's degree from a top-500 globally ranked university is preferred.
Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs.
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales beyond surface-level observations.
- Apply structured evaluation guidelines accurately and with strict attention to detail.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
View Full Description & ApplyYou'll be redirected to the employer's site
