AI Evaluation Specialist
New
W
Weekday AIArtificial Intelligence
United StatesContract
Salary70 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Required Skills
- Attention to detailCritical thinkingResearchQuality Assurance
Requirements
- Bachelor's degree from a globally recognized university.
- Native-level English fluency.
- Excellent analytical thinking and problem-solving abilities.
- Strong written communication skills with the ability to explain complex reasoning clearly.
- Exceptional critical reading skills including identifying nuance, implicit meaning, and logical inconsistencies.
- Strong attention to detail and ability to apply structured evaluation guidelines.
- Ability to work independently and manage assigned tasks efficiently.
Responsibilities
- Review AI-generated content for accuracy, logical reasoning, completeness, and clarity.
- Identify factual errors, reasoning gaps, inconsistencies, and unsupported conclusions.
- Assess responses using structured evaluation frameworks and detailed quality guidelines.
- Write clear, concise, and evidence-based rationales explaining evaluation decisions.
- Highlight both strengths and areas for improvement in AI-generated outputs.
- Follow detailed project instructions and standardized assessment criteria.
- Ensure evaluations are objective, accurate, and reproducible.
View Full Description & ApplyYou'll be redirected to the employer's site