Senior Software Engineer - AI Coding Agents
New
M
MindriftAI Training and Evaluation
Poland. Warsaw, Masovian Voivodeship, Poland. Kraków, Lesser Poland Voivodeship, Poland. Łódź, Łódź Voivodeship, Poland. Poznań, Greater Poland Voivodeship, Poland. Wrocław, Lower Silesian Voivodeship, PolandContractSenior
SalaryUp to $40/hr equivalent, depending on level and pace.
Apply NowOpens the employer's application page
Job Details
- Languages
- English (B2+ proficiency required)
- Experience
- 5+ years
- Required Skills
- DockerPostgreSQLPythonJavascriptKafkaTypeScriptFastAPIRedisReact
Requirements
- 5+ years of professional software development experience.
- Strong proficiency in Python and FastAPI.
- Strong proficiency in JavaScript/TypeScript and React.
- Hands-on experience with Docker, Postgres, Kafka, and Redis.
- Proven experience writing functional and integration tests.
- B2+ level English proficiency.
- Ability to design scenarios that challenge state-of-the-art AI coding models.
- Analytical skills to identify model failure modes.
Responsibilities
- Build realistic developer environments featuring codebases, infrastructure, and project context.
- Design complex tasks from intermediate environment states and craft clear, solvable prompts.
- Define clear success criteria for AI model evaluation.
- Write comprehensive functional and integration tests to verify agent-generated solutions.
- Analyze agent failures and iterate on tasks to ensure evaluation robustness.
- Refine tests to accommodate multiple valid coding solutions while rejecting incorrect ones.
View Full Description & ApplyYou'll be redirected to the employer's site
