AI Product Evaluator

New
R
RemoteJobsOneAI evaluation
India, Japan or United Kingdom, RemoteContract
Salary14 - 36 USD per hour
Apply NowOpens the employer's application page

Job Details

Required Skills
Attention to detail

Requirements

  • Experience with AI products, AI models, or AI agent evaluation and testing is preferred.
  • Follow complex instructions with precision and consistency.
  • Demonstrate attention to detail and operational thoroughness.
  • Be comfortable with repetitive or high-volume operational tasks within strict timeframes.
  • Prior participation in digital product, software QA, or AI research projects is a plus.
  • Document each step of the work.

Responsibilities

  • Evaluate AI models and agents against detailed, predefined scenarios and guidelines.
  • Execute operational tasks to test model accuracy, reasoning, and responsiveness.
  • Document findings, observations, and anomalies in structured written reports.
  • Reset usage limits and repeat evaluations according to project protocols.
  • Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
  • Maintain attention to detail and rigor across evaluation tasks.
View Full Description & ApplyYou'll be redirected to the employer's site
14 - 36 USD per hour
Apply Now