Entertainment Media Content Rater
New
Remote in the MexicoContract
Salary6 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Spanish (Mexico)
Requirements
- Expertise in film and media studies, entertainment journalism, or pop culture commentary.
- Familiarity with narrative structures, character arcs, and cinematic universes.
- Experience in AI data annotation, content quality review, or search quality rating.
- Experience evaluating content using structured grading criteria.
- Attention to detail and ability to identify nuanced content issues.
- Ability to work independently in a remote environment.
- Familiarity with data annotation platforms and model evaluation tools.
Responsibilities
- Review contributor evaluations of model-generated responses to ensure adherence to project-specific guidelines and rubric dimensions.
- Verify that contributors consistently apply all instructions, constraints, and evaluation criteria when assessing model responses.
- Confirm that contributors accurately identify factual errors, hallucinations, or missing information in model responses, ensuring evaluations reflect whether responses fulfill the user query.
- Ensure contributor-selected options align appropriately with rubric dimensions and are justified by the evidence present in the model response.
- Review open-text comments provided by contributors, ensuring they identify areas of opportunity, weaknesses, or limitations that may not have been captured by rubric criteria.
- Provide detailed feedback on contributor performance, highlighting areas for improvement and ensuring evaluations are consistently high-quality.
View Full Description & ApplyYou'll be redirected to the employer's site
