Multilingual Audio Evaluator
A
Anyone AIAI training
Location: Argentina - Fully Remote; Secondary Locations: Italy, Portugal, France, Spain, Netherlands, Brazil, Germany; Remote / Global, subject to project location restrictionsContract
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- C1/C2 spoken fluency in at least one of: Welsh, Dutch, Greek, Italian, French, German, Portuguese.
- Required Skills
- RESTful APIsJSON
Requirements
- Have C1/C2 spoken fluency in at least one target language: Welsh, Dutch, Greek, Italian, French, German, or Portuguese.
- Demonstrate language proficiency through a speaking and listening assessment.
- Have strong JSON skills, including reading, validation, troubleshooting, and identifying structural or formatting errors.
- Be comfortable using digital tools and collecting recordings and technical logs.
- Show strong attention to detail and follow evaluation guidelines consistently.
- Communicate clearly in writing and use sound judgment when assessing AI interactions.
- Experience in AI evaluation, audio annotation, or transcript labeling is a nice to have.
- A background in technical support, quality assurance, or software development is a nice to have.
- Familiarity with conversational AI, APIs, and structured data is a nice to have.
Responsibilities
- Prepare and confirm required tools and access before each live session.
- Conduct live, real-time roleplay scenarios with conversational AI agents.
- Capture recordings, session IDs, and tool-call or console logs.
- Label conversation transcripts according to project guidelines.
- Score interactions against structured evaluation rubrics.
- Provide written explanations supporting evaluation scores.
- Read, validate, and troubleshoot JSON, identifying structural and formatting issues.
View Full Description & ApplyYou'll be redirected to the employer's site
