Staff Quality Engineer
New
S
StackAdaptAdvertising Technology
StackAdapt is a remote-first company; we are open to candidates located anywhere in Canada and the United States for this position.Full-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years
- Required Skills
- PythonCypressJavaJavascriptJestJUNITTypeScriptCI/CDPlaywright
Requirements
- 7+ years of professional, hands-on software quality and test automation experience.
- Deep, hands-on experience with API and UI test automation frameworks (e.g., Playwright, Cypress, Jest, or Junit).
- Fluency in at least one of TypeScript, JavaScript, Python, or Java (TypeScript preferred).
- Experience testing AI/agentic systems including evals, prompt/regression testing, and output validation.
- Experience using AI to scale automation such as test generation or self-healing tests.
- Experience with CI/CD tools like Jenkins, Github Actions, or CircleCI.
- Strong understanding of scalable system design for web-based APIs and backend processing.
- In-depth understanding of QA methodologies in fast release cycle environments.
- Proven ability to define test case design standards and coverage strategy.
- Experience owning test case management practices (e.g., TestRail).
- Knowledge of React and data-testids.
- Ability to explore codebases to understand technical implementation.
Responsibilities
- Own and drive the end-to-end quality strategy for the Automation and Intelligence Pillar pod's AI products, from test architecture through release readiness.
- Design and build evaluation frameworks for non-deterministic systems, including LLM output quality, agent behaviour, regression detection, and guardrail/safety testing.
- Develop reliable, scalable automated test suites and tooling for functional, API, integration, UI, and regression testing integrated into CI/CD pipelines.
- Establish quality metrics and benchmarks for accuracy, latency, cost, and failure rates to inform data-driven release decisions.
- Partner with engineering, product, and data science teams to align requirements and definitions of done.
- Act as a technical mentor and force multiplier across the QE organization, driving process improvements and AI testing best practices.
- Participate in technical planning, code review, and architectural decision-making to advocate for testability.
View Full Description & ApplyYou'll be redirected to the employer's site
