Senior Test Automation Engineer, AI-Native
New
Arbeite innerhalb Deutschlands von wo du möchtest!Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PostgreSQLCypressMySQLVue.JsCI/CDRESTful APIsPlaywright
Requirements
- Proven experience with test automation using Playwright, Cypress, or similar tools, ideally with AI-codegen integration.
- Daily use of AI tools like Claude, ChatGPT, and AI-powered IDEs such as Cursor for test generation and analysis.
- Familiarity with LLM evaluation frameworks (e.g., Promptfoo, Braintrust, LangSmith).
- Understanding of MCP, agentic workflows, or Custom GPTs and systematic testing methods for them.
- Experience with CI/CD tools (GitHub Actions, GitLab CI), Git, and PR-based development workflows.
- Solid understanding of API testing (REST), databases (MySQL/Postgres), and web architectures.
- Ability to balance AI-generated tests with precise, manual test design and assertions.
- Experience with mobile app testing (iOS & Android) is a plus.
Responsibilities
- Build and operate a modern, AI-supported test strategy for the next product generation (Laravel/Vue.js).
- Implement end-to-end test automation with Playwright, leveraging AI for test case generation and self-healing.
- Perform quality assurance for AI products by evaluating LLM outputs, running prompt tests, and conducting hallucination checks.
- Develop a testing pyramid (Unit, Integration, E2E) in collaboration with developers and integrate into CI/CD pipelines.
- Conduct AI-supported bug reproduction and root-cause analysis, translating customer tickets into reproducible tests.
- Collaborate closely with developers, product managers, and the Co-CEO.
View Full Description & ApplyYou'll be redirected to the employer's site