Senior Software Engineer - Agent Evaluation
New
M
MindriftAI Testing
Open to candidates in the North America, South America, Asia and Europe.ContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English proficiency - B2+
- Experience
- 5+ years
- Required Skills
- DockerPythonJavascriptKafkaTypeScriptFastAPIPostgresRedisReact
Requirements
- 5+ years in software development.
- Proficiency in Python (FastAPI).
- Proficiency in JavaScript/TypeScript (React).
- Experience with Docker, Postgres, Kafka, and Redis.
- Experience writing functional and integration tests.
- B2+ level English proficiency.
- Ability to complete a technical assessment.
- Willingness to complete identity verification.
- Willingness to participate in project communication via Discord.
- Successful completion of a background check.
Responsibilities
- Build realistic developer environments including codebase, infrastructure, tickets, and documentation.
- Design tasks from intermediate environmental states, crafting prompts and defining solvable success criteria.
- Write comprehensive tests that verify agent solutions, accepting valid approaches and rejecting incorrect ones.
- Iterate on tasks and tests based on QA feedback.
- Review agent solutions and analyze failures to refine evaluation robustness.
View Full Description & ApplyYou'll be redirected to the employer's site
