Data Science Specialist
New
M
MercorData science, AI evaluation
Source API remote eligibility restrictions: IndiaContractSenior
Salary120 - 170 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of professional data science experience in industry.
- Required Skills
- PythonSQLData scienceWritten communicationA/B testing
Requirements
- Have 5+ years of professional data science experience in industry.
- Have a background in business operations, product, or growth data science at a top-tier technology company.
- Demonstrate deep fluency in experiment design and A/B testing.
- Be fluent in metric definition and SQL/Python analysis.
- Be able to communicate findings to executive stakeholders.
- Have exceptionally strong written communication.
- Be detail-oriented and consistent.
- Be comfortable having your judgment reviewed and calibrated against peers.
- Prior experience with AI training, evaluation, or human-data projects is preferred.
Responsibilities
- Design precise, task-specific grading criteria for real-world data science deliverables, including analyses, models, dashboards, and experiment readouts.
- Score AI-generated and human work samples against the criteria.
- Provide detailed written justifications for every score.
- Apply consistent, evidence-based judgment so scores are reproducible and defensible.
- Incorporate structured feedback from senior reviewers.
- Iterate quickly on evaluation work.
- Work independently and asynchronously to meet deadlines.
- Improve AI model performance.
View Full Description & ApplyYou'll be redirected to the employer's site
