Software Engineer - Python/TypeScript
New
T
TuringAI coding models
North America, LATAM, or India, At least 6 hours of Pacific Time overlapContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of hands-on software engineering experience
- Required Skills
- PythonJavascriptTypeScriptGo
Requirements
- Have 5+ years of hands-on software engineering experience.
- Have strong proficiency in Python, TypeScript/JavaScript, Go, or another major production language.
- Have experience working in substantial real-world codebases.
- Demonstrate strong code-review skills and technical judgment.
- Be able to clearly explain why an implementation is correct, incorrect, or could be improved.
- Have experience using modern LLMs or AI coding tools.
- Have strong written communication.
- Availability of 40 hours per week is preferred; at least 6 hours of Pacific Time overlap is required.
- Experience with LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training is a plus, but not required.
Responsibilities
- Evaluate AI-generated code and solutions across real-world software repositories.
- Review agent behavior, tool usage, and code changes for correctness and quality.
- Identify technical errors, weak approaches, and recurring model failure modes.
- Compare model outputs and explain why one solution is better than another.
- Create and refine rubrics and evaluation criteria for coding tasks.
- Produce evaluation and preference data used to improve coding models.
- Build and maintain pipelines and infrastructure for data generation, collection, and evaluation workflows.
- Synthesize findings into write-ups, updates, and recommendations for the team.
- Collaborate with researchers and engineers to translate qualitative judgment into scalable processes.
View Full Description & ApplyYou'll be redirected to the employer's site