AI Agent Evaluator
New
A
Anyone AIAI training
Argentina - Fully Remote; Secondary Locations: Uruguay, Chile, Poland, Italy, Czech Republic, Estonia, Ecuador - Fully Remote, Portugal, Mexico - Fully Remote, Paraguay, Colombia - Fully Remote, France, Spain, Peru - Fully Remote, BrazilContract
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluency in one of the supported languages/locales: Spanish — Latin America, Arabic, Portuguese — Brazil, Japanese — Japan, Turkish — Turkey, Indonesian — Indonesia, Hindi — India, Korean — Korea, French — France, German — Germany.
- Required Skills
- Attention to detailQuality Assurance
Requirements
- Be fluent in one of the supported languages or locales.
- Have strong reading comprehension and the ability to explain feedback clearly.
- Demonstrate attention to detail and sound judgment when comparing conversation experiences.
- Be willing to interact with AI assistants using relevant personal context and connected services.
- Have recent activity across a qualifying combination of digital services.
- Complete the project's eligibility verification and meet its corresponding expert requirements.
Responsibilities
- Write prompts about questions, interests, or needs relevant to you.
- Have natural, multi-turn conversations with two AI assistants.
- Ask questions that draw on information or activity from connected services where relevant.
- Compare how effectively each assistant uses available information and connects relevant context.
- Assess whether responses are helpful, natural, trustworthy, and safe.
- Evaluate how each assistant responds to feedback and corrections.
- Provide clear explanations supporting your evaluations.
View Full Description & ApplyYou'll be redirected to the employer's site
