Software Engineer - Evaluation Author - AI Trainer
United StatesContractSenior
Salary35 - 120 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- Artificial IntelligenceSoftware EngineeringDebugging
Requirements
- 5+ years of software engineering at a real product organization (big tech or venture-backed startup).
- Strong code quality, systems design, debugging, and testing discipline.
- Clear written communication (you write instructions others follow).
- Familiarity with AI coding tools and evals (preferred).
Responsibilities
- Author non-trivial coding tasks with golden solutions and automated verifiers.
- Design rubrics and grade agent trajectories and model outputs.
- Improve task and rubric quality through structured review.
- Evaluate the accuracy and depth of AI-generated content to strengthen reasoning and rigor in model outputs.
- Work independently and asynchronously to meet deadlines while improving AI model performance.
View Full Description & ApplyYou'll be redirected to the employer's site
