AI Voice Evaluation Specialist
I
InnodataData Engineering AI
Remote - Alabama ; Remote - Alaska ; Remote - Arkansas ; Remote - Delaware ; Remote - Florida ; Remote - Georgia ; Remote - Indiana ; Remote - Maryland ; Remote - Massachusetts ; Remote - New Hampshire ; Remote - New Jersey ; Remote - New York ; Remote - South Carolina ; Remote - TexasFull-Time
Salary20 - 27 USD per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- Analytical SkillsWritten communicationCritical thinkingActive listening
Requirements
- Bachelors Degree.
- Strong attention to detail and ability to notice subtle differences in conversational quality.
- Excellent listening and comprehension skills.
- Strong written communication skills, particularly the ability to explain observations clearly and objectively.
- Ability to follow detailed evaluation guidelines consistently.
- Comfort speaking naturally and roleplaying different conversational scenarios.
- Ability to compare two interactions fairly without allowing personal preferences to influence the evaluation.
- Strong critical-thinking and analytical skills.
- Reliability and consistency when completing structured evaluation tasks.
- Familiarity with AI assistants, voice-based AI, or conversational systems.
Responsibilities
- Review assigned scenarios and roleplay natural conversations with two different AI models.
- Conduct comparable conversations with Model A and Model B, maintaining consistent conversational approaches and turn counts.
- Record voice interactions and monitor the quality and behavior of model responses.
- Evaluate each model across five defined quality dimensions.
- Identify and categorize error clusters observed in audio or conversation.
- Compare the performance of both models and select the stronger performer based on evaluation criteria.
- Write detailed rationales justifying preference with specific examples and observations.
- Apply evaluation guidelines consistently across varying scenarios.
View Full Description & ApplyYou'll be redirected to the employer's site
