Automation Test Engineer
New
S
SkywardGovernment IT
AnywhereFull-TimeMiddle
Salary$110,000 - $130,000 a year
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years of experience in software QA/automation engineering, with at least 1 year focused on AI/ML product testing.
- Required Skills
- PythonCypressMLFlowQA AutomationSeleniumCI/CDPlaywright
Requirements
- 5+ years of experience in software QA/automation engineering.
- At least 1 year of experience focused on AI/ML product testing.
- Strong proficiency in at least one automation framework (e.g., Selenium, Cypress, Playwright).
- Strong proficiency in a scripting language (Python preferred).
- Hands-on experience with testing AI models, including validation metrics, dataset versioning, and model explainability.
- Familiarity with tools like MLflow, TensorBoard, or similar for AI observability.
- Understanding of model bias, fairness audits, and compliance considerations in government or regulated environments.
- Experience working in Agile DevSecOps environments with modern CI/CD tooling (Jenkins, GitHub Actions, GitLab, etc.).
- Strong collaboration skills with a knack for clear communication across engineering, data science, and product teams.
Responsibilities
- Design and maintain robust, scalable automated test frameworks for web apps, APIs, and AI-driven features.
- Develop automated pipelines for model validation, bias detection, and drift monitoring in ML-based systems.
- Define and execute test plans that include functional, regression, performance, and AI-specific testing strategies.
- Partner with AI/ML engineers to create test datasets and simulate real-world user behavior and edge cases.
- Implement CI/CD-integrated quality gates to ensure AI releases meet defined reliability and fairness metrics.
- Mentor junior engineers and help establish best practices in intelligent automation and AI testing.
- Advocate for ethical AI standards and contribute to cross-functional discussions about responsible AI.
View Full Description & ApplyYou'll be redirected to the employer's site
