AI Evaluation Specialist

New
W
Weekday AIArtificial Intelligence
United StatesContract
Salary70 USD per hour
Apply NowOpens the employer's application page

Job Details

Languages
English
Required Skills
Attention to detailCritical thinkingResearchQuality Assurance

Requirements

  • Bachelor's degree from a globally recognized university.
  • Native-level English fluency.
  • Excellent analytical thinking and problem-solving abilities.
  • Strong written communication skills with the ability to explain complex reasoning clearly.
  • Exceptional critical reading skills including identifying nuance, implicit meaning, and logical inconsistencies.
  • Strong attention to detail and ability to apply structured evaluation guidelines.
  • Ability to work independently and manage assigned tasks efficiently.

Responsibilities

  • Review AI-generated content for accuracy, logical reasoning, completeness, and clarity.
  • Identify factual errors, reasoning gaps, inconsistencies, and unsupported conclusions.
  • Assess responses using structured evaluation frameworks and detailed quality guidelines.
  • Write clear, concise, and evidence-based rationales explaining evaluation decisions.
  • Highlight both strengths and areas for improvement in AI-generated outputs.
  • Follow detailed project instructions and standardized assessment criteria.
  • Ensure evaluations are objective, accurate, and reproducible.
View Full Description & ApplyYou'll be redirected to the employer's site
70 USD per hour
Apply Now