Senior QA Automation Engineer - P3

New
I
InnovecsSupply Chain & Logistics
Europe, UkraineFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Languages
Advanced English
Experience
5+ years of experience in Quality Assurance and Test Automation; 2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems.
Required Skills
AWSPythonCypressAPI testingAzureSeleniumCI/CDPlaywright

Requirements

  • 5+ years of experience in Quality Assurance and Test Automation.
  • 2+ years of experience testing AI-enabled applications, LLM solutions, or agentic systems.
  • Strong Python programming skills.
  • Experience with Playwright, Selenium, Cypress, or similar automation frameworks.
  • Solid understanding of software testing methodologies and test design techniques.
  • Experience with API, integration, and database testing.
  • Experience with CI/CD pipelines and DevOps practices.
  • Knowledge of AI evaluation frameworks and AI-specific failure modes (hallucinations, prompt injection, model drift).
  • Experience working in cloud-native environments (Azure or AWS).
  • Understanding of MCP architecture and agent-to-tool integrations.
  • Advanced English proficiency.

Responsibilities

  • Design and execute quality strategies for AI-powered warehouse assistants, copilots, and autonomous agents.
  • Build evaluation frameworks for LLM-based warehouse workflows and agentic systems.
  • Define and maintain golden datasets and benchmark scenarios for warehouse operations.
  • Perform hallucination, factuality, grounding, and response-quality testing.
  • Conduct adversarial testing, prompt injection testing, and jailbreak assessments.
  • Create and maintain scalable automation frameworks for functional, API, integration, and end-to-end testing.
  • Validate enterprise integrations across WMS, ERP, TMS, OMS, WCS, and third-party platforms.
  • Define AI quality standards and support compliance with EU AI Act and ISO 42001.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now