LLM Red Team Specialist
New
M
MercorAI Research
United StatesContractMiddle
Salary60 - 90 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- 1+ years
- Required Skills
- PythonCybersecurityGitMachine LearningLLM
Requirements
- MSc or PhD in a STEM field or equivalent experience.
- 1+ years in research, research-engineering, security, or AI evaluation.
- Experience identifying vulnerabilities in LLMs or ML systems.
- Proficiency in Python and Git.
- Familiarity with LLM capabilities and evaluation techniques.
- Ability to work 35 hours/week.
Responsibilities
- Evaluate frontier AI models on coding, ML, and analysis tasks to identify vulnerabilities and failure modes.
- Design complex tasks that challenge models and are fair for grading.
- Document findings with clear evidence and reproducible steps.
- Collaborate with task authors to close loopholes and improve grading.
- Share insights with researchers to enhance benchmark quality.
- Work independently and asynchronously to meet deadlines and improve AI model performance.
View Full Description & ApplyYou'll be redirected to the employer's site
