German Audio Evaluations Specialist
New
J
JobgetherConversational AI
Based remotely in NetherlandsContract
Salary6 - 65 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Native or bilingual proficiency in German, with strong reading, writing, listening, and speaking skills.
- Required Skills
- Analytical SkillsJSONCustomer support
Requirements
- Have native or bilingual German proficiency, with strong reading, writing, listening, and speaking skills.
- Have professional experience in complex customer support, technical troubleshooting, or conversational AI evaluation.
- Have strong analytical and problem-solving skills to assess responses objectively and identify inconsistencies.
- Be able to conduct realistic customer service role-plays.
- Have basic programming literacy, including familiarity with JSON structures, functions, methods, and simple logical concepts.
- Pay close attention to detail and follow complex instructions, structured prompts, and evaluation rubrics.
- Have access to a high-quality microphone for clear audio input.
- Have a secure computer and high-speed internet connection suitable for remote work.
Responsibilities
- Create and execute role-play scenarios simulating customer service interactions in travel, financial services, telecommunications, and technical support.
- Evaluate AI-generated audio interactions using standardized qualitative and quantitative criteria.
- Assess task completion, conversational naturalness, and audio comprehension.
- Assess the model’s ability to understand basic programming concepts, including JSON structures, functions, methods, and structured data.
- Identify weaknesses in conversational accuracy, clarity, reasoning, and adherence to task requirements.
- Generate evaluation datasets reflecting realistic customer expectations and natural conversational flow.
- Follow prompts, evaluation rubrics, and technical guidelines to produce consistent results.
- Deliver accurate assessments and structured feedback to support conversational AI improvement.
View Full Description & ApplyYou'll be redirected to the employer's site
