AI Coding Specialist
New
M
MercorAI research
Source API remote eligibility restrictions: United StatesContractJunior
Salary60 - 90 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- 1+ years of experience in research, research-engineering, or software engineering.
- Required Skills
- PythonGitSoftware EngineeringDebuggingPrompt Engineering
Requirements
- Have an MSc or PhD in computer science or a related STEM field, or equivalent practical experience.
- Have 1+ years of experience in research, research-engineering, or software engineering.
- Demonstrate strong Python scripting and debugging skills.
- Be fluent with Git, IDEs, and standard software development workflows.
- Be able to work independently on open-ended problems.
- Preferred: experience with AI coding assistants, prompt engineering, or agent workflows.
- Preferred: past experience in AI training, model evaluation, or benchmark/task authoring.
Responsibilities
- Design realistic, multi-step software engineering challenges to test AI coding agents.
- Build reference solutions using Python with clear, verifiable answers.
- Work with AI coding assistants to identify their strengths and weaknesses in your workflow.
- Review tasks from fellow experts for clarity, correctness, and difficulty.
- Analyze AI agent failures to help the research team understand task challenges.
View Full Description & ApplyYou'll be redirected to the employer's site