Python Senior Software Engineer, AI Training

NewInactive
J
JobgetherAI development tools
Based in IndiaContractSenior
This job is no longer active. We keep the page for reference, but the employer may not accept new applications.

Open jobs in this role

Job Details

Languages
Strong written and spoken English proficiency (B2 level or above)
Required Skills
PythonCritical thinking

Requirements

  • Have Senior, Staff, or Principal-level software engineering experience, or equivalent professional expertise.
  • Bring a strong professional background in Python.
  • Have hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.
  • Have deep familiarity with modern AI-assisted software development workflows.
  • Be able to evaluate code and technical responses without necessarily executing the code or reviewing every line.
  • Have strong written and spoken English proficiency at B2 level or above.
  • Provide direct, constructive, well-supported opinions and detailed written feedback.
  • Distinguish technical correctness from genuinely useful engineering guidance.
  • Bring strong critical thinking and communication skills and a high standard for engineering quality.
  • Experience with TypeScript or JavaScript is relevant.
  • Previous exposure to prompt design, AI evaluation, or model assessment workflows is a plus.
  • Experience mentoring senior engineers or defining engineering standards and best practices is a plus.

Responsibilities

  • Evaluate AI-generated coding interactions from beginning to end.
  • Assess whether AI outputs are useful, technically sound, and aligned with experienced software engineering practices.
  • Evaluate the quality of explanations, reasoning, and recommendations, not just code correctness.
  • Apply consistent standards to distinguish varying levels of response quality.
  • Provide clear, detailed feedback on what works, what does not, and what may be inaccurate or ineffective.
  • Assess whether AI models guide developers effectively, provide context, and build trust.
  • Help define and refine quality benchmarks for AI coding agents, including OpenAI Codex, Claude Code, and Cursor.
  • Record short video explanations of evaluation findings.