AI Quality Analyst
New
G
Gramian Consulting GroupIT Services / AI
India, Pakistan, Bangladesh, Egypt, Ghana, Nigeria, minimum 4h PST overlapContractMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Chinese
Requirements
- Professional proficiency in written and spoken Chinese
- Bachelor's degree or equivalent experience in a relevant field
- Strong analytical and critical thinking skills
- Experience in AI evaluation, data annotation, content moderation, research, or similar analytical work is preferred
- Ability to assess nuanced and subjective quality differences in AI responses
- Strong written communication skills
- Comfortable working with AI tools and conversational systems
- Willingness to use a primary personal Google account as part of the evaluation process
Responsibilities
- Create realistic multi-turn conversational scenarios in Chinese
- Evaluate AI-generated responses for relevance, accuracy, and usefulness
- Assess how effectively personal context is incorporated into responses
- Compare and rank multiple AI responses side-by-side
- Identify grounding issues, unsupported assumptions, and incorrect personalization
- Review conversation quality, tone, and naturalness
- Write clear evaluation rationales and structured feedback
- Verify that AI systems correctly utilize available context and data sources
- Follow evaluation guidelines and maintain high-quality standards
- Manage evaluation data according to project requirements
View Full Description & ApplyYou'll be redirected to the employer's site
