Senior QA Engineer, AI & Automation

BackcountryE-commerce

Remote (US, Canada, or Costa Rica)Full-TimeSenior

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

Experience: 5+ years of experience in Quality Assurance and Testing, including 3+ years building and maintaining test automation that runs in CI/CD.
Required Skills: PythonJavascriptJMeterTypeScriptCI/CDGitHub ActionsPostmanPlaywright

Bring 5+ years of Quality Assurance and Testing experience, including 3+ years building and maintaining test automation in CI/CD.
Have hands-on Playwright experience for web and API end-to-end automation.
Design, build, and maintain scalable, reliable test suites and frameworks, and diagnose and eliminate flaky tests.
Be proficient in TypeScript/JavaScript or Python; Java is a plus.
Have day-to-day experience using AI coding tools such as Claude Code, GitHub Copilot, or Cursor, and validate and correct generated output.
Have experience integrating automated tests into CI/CD pipelines; GitHub Actions is preferred.
Have experience with functional, regression, API, and performance/load testing using Postman, JMeter, k6, or equivalent.
Bring strong exploratory testing skills and the judgment to create risk-based testing strategies.
Have SDLC and Agile experience, including defect lifecycle management with Jira and TestRail.
Be able to work under a steady release cadence, manage competing priorities, and operate with minimal supervision.
E-commerce QA automation, agentic testing workflows, AI/ML feature testing, BrowserStack, and Grafana or GCP experience are preferred.

Build and maintain scalable Playwright automation suites across web, API, and mobile.
Use AI coding assistants and agents to generate test plans, test cases, page objects, and test data.
Review, validate, and harden AI-generated tests before merging.
Reduce flaky tests and maintenance through resilient locator strategies, self-healing, and automated failure triage.
Integrate automated quality gates into GitHub Actions CI/CD pipelines.
Build functional, regression, API, and performance/load testing coverage.
Perform exploratory testing on new features, UI/UX changes, and complex user flows.
Turn escaped defects into automated regression checks and partner with engineers on tests and API contract checks.
Define evaluation approaches for AI-powered search and recommendation experiences with non-deterministic outputs.
Track quality metrics and mentor QA engineers on automation and responsible AI-assisted testing.

View Full Description & ApplyYou'll be redirected to the employer's site