AI Quality Analyst
New
G
Gramian Consulting GroupAI Consultancy
Turkey, minimum 4h PST overlapContractMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Turkish, Chinese
- Required Skills
- Analytical thinking
Requirements
- Professional proficiency in written and spoken Turkish
- Chinese fluency
- Bachelor's degree or equivalent experience
- Strong analytical and critical thinking skills
- Strong written communication skills
- Comfortable working with AI tools and conversational systems
- Willingness to use a primary personal Google account as part of the evaluation process
Responsibilities
- Create realistic multi-turn conversational scenarios in Turkish
- Evaluate AI-generated responses for relevance, accuracy, and usefulness
- Assess how effectively personal context is incorporated into responses
- Compare and rank multiple AI responses side-by-side
- Identify grounding issues, unsupported assumptions, and incorrect personalization
- Review conversation quality, tone, and naturalness
- Write clear evaluation rationales and structured feedback
- Verify that AI systems correctly utilize available context and data sources
- Follow evaluation guidelines and maintain high-quality standards
- Manage evaluation data according to project requirements
View Full Description & ApplyYou'll be redirected to the employer's site
