AI Evaluation Specialist
Y
YO AI LabsAI evaluation
United StatesContract
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English fluency is required but does not need to be your first language.
- Required Skills
- Critical thinkingResearch
Requirements
- Conduct independent research and critically evaluate information from multiple sources.
- Demonstrate excellent English writing skills, precision, and clarity.
- Create nuanced, well-structured questions that assess deep understanding and complex reasoning.
- Apply analytical thinking, problem-solving, and information-synthesis skills.
- Work independently with self-motivation, reliability, and accountability.
- Meet the project's weekly task submission requirements.
- Be ready to begin promptly; selected candidates are expected to start their first tasks within 24–48 hours of completing onboarding.
- Prior experience in AI training, model evaluation, research, or content creation is advantageous but not required.
Responsibilities
- Develop original, challenging question-and-answer pairs to test advanced AI models across diverse subject areas.
- Conduct in-depth research and cross-verify information using multiple reliable sources.
- Create multi-step questions requiring analytical reasoning, synthesis, and critical thinking.
- Test questions against AI models, analyze their responses, and refine question difficulty.
- Document research processes with clear citations, evidence, and logical explanations.
- Revise and improve content based on reviewer feedback and project guidelines.
- Maintain consistency, accuracy, and clarity across submitted tasks.
View Full Description & ApplyYou'll be redirected to the employer's site
