Senior Software Engineer, AI Coding Agent Evaluation
New
G
G2iAI software
Remote, worldwidePart-TimeSenior
Salary100 - 200 USD per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Strong written and spoken English (B2 or above)
- Required Skills
- PythonJavascriptTypeScript
Requirements
- Be a Senior, Staff, or Principal-level engineer, or have equivalent experience.
- Have a strong background in TypeScript/JavaScript or Python.
- Have hands-on experience with at least one of OpenAI Codex, Claude Code, or Cursor.
- Have deep familiarity with modern AI-assisted development workflows.
- Be able to evaluate code without executing it or reviewing every line.
- Have strong written and spoken English at B2 level or above.
- Be comfortable giving direct, opinionated feedback.
- Have a high bar for what good engineering looks like.
- Prior exposure to prompt design or evaluation workflows is a nice-to-have.
- Experience mentoring senior engineers or defining engineering standards is a nice-to-have.
Responsibilities
- Evaluate AI-generated coding interactions end to end.
- Judge whether outputs are useful, correct at a high level, and aligned with strong engineering judgment.
- Assess the quality of explanations and reasoning, not just the code.
- Distinguish between levels of response quality.
- Write clear, opinionated feedback about what worked, what did not, and what felt off or misleading.
- Help define what great interactions look like when working with Cursor, Codex, and Claude Code.
- Record short video explanations of evaluation feedback.
View Full Description & ApplyYou'll be redirected to the employer's site
