Video Games Reviewer (AI Evaluation)
G
Gramian ConsultancyIT professional services
Remote - USA, At least 4 hours of PST overlapContractMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Experience
- At least 3 years
- Required Skills
- Game DesignGame DevelopmentAnalytical SkillsQuality AssuranceLLM
Requirements
- Master’s degree or higher in Game Design, Interactive Media, Computer Science, or a closely related discipline.
- At least 3 years of professional, research, teaching, or industry experience in the video games domain.
- Strong knowledge of game development, gaming platforms, publishers, genres, esports, or gaming communities.
- Experience reviewing, evaluating, editing, or quality-checking technical or domain-specific content.
- Ability to identify subtle factual, logical, and contextual errors.
- Excellent written English communication skills.
- Strong analytical ability and attention to detail.
- Ability to work independently in a quality-focused remote environment.
Responsibilities
- Review and validate video game-focused prompts across a broad range of gaming topics.
- Evaluate completed tasks for factual accuracy, reasoning quality, completeness, and relevance.
- Identify factual errors, hallucinations, logical inconsistencies, and weak annotations.
- Verify claims related to games, publishers, platforms, genres, esports, and game development.
- Assess whether prompts are sufficiently challenging and aligned with project objectives.
- Ensure compliance with project instructions, review rubrics, and quality standards.
- Provide clear, constructive, and evidence-based feedback to contributors.
- Document review findings and escalate ambiguous or complex cases when required.
- Collaborate with project managers and AI teams to improve evaluation quality and workflows.
View Full Description & ApplyYou'll be redirected to the employer's site
