AI Agent Evaluation Specialist
New
M
MindriftAI evaluation
This opportunity is only for candidates currently residing in the specified country.Contract
SalaryRates that can go up to $25/hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Your level of English is advanced (C1) or above.
- Required Skills
- Artificial IntelligenceMachine LearningData scienceSoftware EngineeringNLP
Requirements
- Have or be currently pursuing a bachelor's or master's degree in Computer Science, Software Engineering, Data Science or Data Analytics, Artificial Intelligence or Machine Learning, Computational Linguistics or Natural Language Processing, Information Systems, or a related field.
- Have advanced English proficiency (C1) or above.
- Be ready to learn new methods.
- Be able to switch quickly between tasks and topics.
- Be prepared to work with challenging, complex guidelines.
Responsibilities
- Design structured test scenarios based on real-world tasks.
- Define the golden path and acceptable agent behavior.
- Annotate task steps, expected outputs, and edge cases.
- Work with developers to test scenarios and improve clarity.
- Review agent outputs and adapt tests accordingly.
View Full Description & ApplyYou'll be redirected to the employer's site
