Senior Testing Engineer
New
R
Robots & PencilsAI Engineering
Bogota, Colombia (Remote Friendly)Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 3–4+ years
- Required Skills
- PythonCypressJavaJavascriptJiraSeleniumCI/CDMLOpsPlaywright
Requirements
- 3–4+ years of experience in QA, data QA, or AI testing.
- Strong programming skills in Python and at least one other language (e.g., Java, JavaScript).
- Hands-on experience designing and maintaining automation frameworks (e.g., Selenium, Cypress, Playwright, PyTest, TestNG, Cucumber).
- Strong understanding of the ML lifecycle and experience with model evaluation metrics (accuracy, precision, recall, bias, drift).
- Knowledge of AI testing methodologies including LLM validation, hallucination testing, and data pipeline validation.
- Experience with CI/CD pipelines, API automation, and version control (e.g., GitHub Actions, Postman, Git).
- Familiarity with MLOps pipelines and model monitoring in production environments.
- Strong understanding of Agile methodologies and experience with test management tools (e.g., Jira, TestRail).
- Demonstrable usage of AI-forward tools such as Claude and Cursor.
Responsibilities
- Design and develop scalable automation frameworks for UI, API, and integration testing.
- Integrate automated tests into CI/CD pipelines and drive CI/CD quality gates.
- Design AI-specific test strategies and validate ML models across key metrics including accuracy, precision, recall, bias, and drift.
- Test data pipelines, feature engineering processes, and validate LLM responses for hallucination risk and output consistency.
- Monitor model quality in production environments and support release validation.
- Collaborate closely with developers, ML engineers, DevOps, and product teams across the full SDLC.
- Lead quality efforts end-to-end with growing ownership of testing strategy and automation architecture.
- Contribute to QA standards and best practices, and identify opportunities to improve coverage and reliability.
View Full Description & ApplyYou'll be redirected to the employer's site
