Senior QA Automation Engineer - P3
New
I
InnovecsSupply Chain & Logistics
Europe, UkraineFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Advanced English
- Experience
- 5+ years of experience in Quality Assurance and Test Automation; 2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems.
- Required Skills
- AWSPythonCypressAPI testingAzureSeleniumCI/CDPlaywright
Requirements
- 5+ years of experience in Quality Assurance and Test Automation.
- 2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems.
- Strong Python programming skills.
- Experience with Playwright, Selenium, Cypress, or similar automation frameworks.
- Solid understanding of software testing methodologies and test design techniques.
- Experience with API, integration, and database testing.
- Experience with CI/CD pipelines and DevOps practices.
- Knowledge of AI evaluation frameworks and AI-specific failure modes (hallucinations, prompt injection, model drift).
- Experience working in cloud-native environments (Azure or AWS).
- Understanding of MCP architecture and agent-to-tool integrations.
- Advanced English proficiency.
Responsibilities
- Design and execute quality strategies for AI-powered warehouse assistants, copilots, and autonomous agents.
- Build evaluation frameworks for LLM-based warehouse workflows and agentic systems.
- Define and maintain golden datasets and benchmark scenarios for warehouse operations.
- Perform hallucination, factuality, grounding, and response-quality testing.
- Conduct adversarial testing, prompt injection testing, and jailbreak assessments.
- Create and maintain scalable automation frameworks for functional, API, integration, and end-to-end testing.
- Validate enterprise integrations across WMS, ERP, TMS, OMS, WCS, and third-party platforms.
- Define AI quality standards and support compliance with EU AI Act and ISO 42001.
View Full Description & ApplyYou'll be redirected to the employer's site