Data Scientist - AI Evaluation
M
MercorAI evaluation
Source API remote eligibility restrictions: United StatesContractJunior
Salary100 - 150 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- 1+ years of professional data science experience.
- Required Skills
- PythonSQLMachine LearningData scienceWritten communication
Requirements
- Have at least 1 year of professional data science experience.
- Have experience at a leading technology, research, or quantitative firm.
- Demonstrate strong command of Python.
- Demonstrate strong command of SQL.
- Demonstrate strong command of statistical modeling.
- Demonstrate strong command of machine learning.
- Write clearly to convey technical findings.
- Take a detail-oriented and consistent approach to evaluating complex work.
Responsibilities
- Design task-specific grading criteria for exploratory data analyses, statistical modeling work, machine learning pipelines, and technical reports.
- Evaluate AI-generated or human-created work against established criteria for quality and accuracy.
- Provide written justifications for evaluations and scores.
- Apply consistent, evidence-based judgment to produce reproducible and defensible assessments.
- Incorporate structured feedback from senior reviewers and iterate on submitted work.
View Full Description & ApplyYou'll be redirected to the employer's site
