Software Engineer - Python/TypeScript

New
T
TuringAI coding models
North America, LATAM, or India, At least 6 hours of Pacific Time overlapContractSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Experience
5+ years of hands-on software engineering experience
Required Skills
PythonJavascriptTypeScriptGo

Requirements

  • Have 5+ years of hands-on software engineering experience.
  • Have strong proficiency in Python, TypeScript/JavaScript, Go, or another major production language.
  • Have experience working in substantial real-world codebases.
  • Demonstrate strong code-review skills and technical judgment.
  • Be able to clearly explain why an implementation is correct, incorrect, or could be improved.
  • Have experience using modern LLMs or AI coding tools.
  • Have strong written communication.
  • Availability of 40 hours per week is preferred; at least 6 hours of Pacific Time overlap is required.
  • Experience with LLM evaluation, coding agents, RLHF, preference data, rubric design, or post-training is a plus, but not required.

Responsibilities

  • Evaluate AI-generated code and solutions across real-world software repositories.
  • Review agent behavior, tool usage, and code changes for correctness and quality.
  • Identify technical errors, weak approaches, and recurring model failure modes.
  • Compare model outputs and explain why one solution is better than another.
  • Create and refine rubrics and evaluation criteria for coding tasks.
  • Produce evaluation and preference data used to improve coding models.
  • Build and maintain pipelines and infrastructure for data generation, collection, and evaluation workflows.
  • Synthesize findings into write-ups, updates, and recommendations for the team.
  • Collaborate with researchers and engineers to translate qualitative judgment into scalable processes.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now