Analytical Evaluator - AI Feedback
M
MercorAI evaluation
AustraliaContract
Salary70 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Native English fluency required.
- Required Skills
- Analytical SkillsWritten communication
Requirements
- Demonstrate strong analytical skills.
- Have strong written communication skills.
- Work independently and follow detailed task guidelines.
- Use critical reading skills to identify nuance, implicit meaning, and gaps in reasoning.
- Have native English fluency.
- A bachelor's degree from a top-500 globally ranked university is preferred.
Responsibilities
- Evaluate AI-generated responses to strengthen reasoning and rigor in model outputs.
- Provide structured written feedback to improve training data quality and downstream performance.
- Develop clear, precise, and well-evidenced written rationales that go beyond surface-level observations.
- Apply consistent and honest judgment, including critical assessments when warranted.
- Work independently and asynchronously to meet deadlines.
View Full Description & ApplyYou'll be redirected to the employer's site
