Senior Software Engineer, AI Coding Agents
New
J
JobgetherAI software
Based in United KingdomContractSenior
Salary100 - 200 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Strong written and spoken English proficiency (B2 level or above).
- Required Skills
- PythonJavascriptTypeScript
Requirements
- Be a Senior, Staff, or Principal-level software engineer, or have equivalent professional experience.
- Have a strong background in TypeScript, JavaScript, or Python.
- Have hands-on experience using at least one of OpenAI Codex, Claude Code, or Cursor.
- Be deeply familiar with modern AI-assisted software development workflows.
- Be able to evaluate code and technical responses without necessarily executing the code or reviewing every line.
- Have strong written and spoken English proficiency at B2 level or above.
- Be able to provide direct, thoughtful, and opinionated feedback.
- Have high standards for software engineering quality and understand what makes technical guidance useful.
- Be able to assess engineering judgment, communication quality, and developer experience beyond basic technical correctness.
- Previous experience with prompt design, AI evaluation, or model assessment workflows is a plus.
- Experience mentoring senior engineers or establishing engineering standards and best practices is a plus.
Responsibilities
- Evaluate AI-generated coding interactions from beginning to end, including responses, explanations, and recommendations.
- Assess whether outputs are useful, broadly correct, and consistent with strong software engineering judgment and practices.
- Review explanations and reasoning, not only code syntax or implementation details.
- Distinguish response quality levels using consistent evaluation criteria.
- Provide clear, detailed, constructive written feedback on what worked and what was inaccurate, misleading, or ineffective.
- Evaluate whether AI agents guide developers effectively, build trust, and provide meaningful assistance.
- Help define and refine quality standards for OpenAI Codex, Claude Code, and Cursor interactions.
- Record short video explanations of evaluation findings and provide context.
View Full Description & ApplyYou'll be redirected to the employer's site
