Baseball Expert - AI Evaluator
New
M
MercorAI evaluation
Source API remote eligibility restrictions: United StatesContractJunior
Salary100 - 120 USD per other
Apply NowOpens the employer's application page
Job Details
- Languages
- Strong written English
- Experience
- 1+ year of professional work experience.
- Required Skills
- Attention to detail
Requirements
- Have at least 1 year of professional work experience.
- Have solid knowledge of baseball rules, teams, players, and postseason structure.
- Be comfortable using AI chat assistants and web search.
- Have strong written English and sharp attention to detail.
- Be based in the United States.
- Avid MLB fandom or general sports enthusiasm is preferred.
- Prior AI rating or evaluation experience is preferred.
Responsibilities
- Follow live MLB postseason games and ask AI assistants questions about scores, win probability, player and team stats, rules, challenges, schedules, broadcasts, highlights, and analysis.
- Run the same question on two AI products side by side, as a single question or a multi-turn conversation of 2 to 10 turns.
- Capture share links and full screenshots of every conversation.
- Rate each response for helpfulness, factual accuracy, and presentation.
- Choose which product performed better and write a clear rationale.
- Work independently and asynchronously during game windows on scheduled game days.
View Full Description & ApplyYou'll be redirected to the employer's site
