AI Product Evaluator
New
R
RemoteJobsOneAI evaluation
India, Japan or United Kingdom, RemoteContract
Salary14 - 36 USD per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Attention to detail
Requirements
- Experience with AI products, AI models, or AI agent evaluation and testing is preferred.
- Follow complex instructions with precision and consistency.
- Demonstrate attention to detail and operational thoroughness.
- Be comfortable with repetitive or high-volume operational tasks within strict timeframes.
- Prior participation in digital product, software QA, or AI research projects is a plus.
- Document each step of the work.
Responsibilities
- Evaluate AI models and agents against detailed, predefined scenarios and guidelines.
- Execute operational tasks to test model accuracy, reasoning, and responsiveness.
- Document findings, observations, and anomalies in structured written reports.
- Reset usage limits and repeat evaluations according to project protocols.
- Record findings and submit evaluation datasets on AI training platforms in line with project standards and milestones.
- Maintain attention to detail and rigor across evaluation tasks.
View Full Description & ApplyYou'll be redirected to the employer's site