AI Software Engineer - Task Curator
New
M
MercorAI software
United StatesPart-TimeJunior
Salary60 - 90 USD per hour
Apply NowOpens the employer's application page
Job Details
- Experience
- 1+ years of experience in research, research-engineering, or software engineering.
- Required Skills
- PythonGitDebuggingPrompt Engineering
Requirements
- Have an MSc or PhD in computer science or a related STEM field, or equivalent practical experience.
- Have 1+ years of experience in research, research-engineering, or software engineering.
- Demonstrate strong Python scripting and debugging skills.
- Be fluent with Git, IDEs, and standard software development workflows.
- Work independently on open-ended problems.
- Experience with AI coding assistants, prompt engineering, or agent workflows is preferred.
- Past experience in AI training, model evaluation, or benchmark/task authoring is preferred.
Responsibilities
- Design realistic, multi-step software engineering challenges for AI coding agents.
- Build reference solutions in Python with clear, verifiable answers.
- Work with AI coding assistants to identify their strengths and weaknesses in your workflow.
- Review fellow experts’ tasks for clarity, correctness, and difficulty.
- Analyze AI agent failures to help the research team understand task challenges.
View Full Description & ApplyYou'll be redirected to the employer's site