QA / DevOps Engineer
New
N
NetSpeekAI Infrastructure
United States. CanadaFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 3+ years of combined QA and DevOps experience
- Required Skills
- AWSDockerQAAPI testingCI/CDDevOpsPostman
Requirements
- 3+ years of combined QA and DevOps experience.
- Owned a CI/CD pipeline end-to-end in production.
- Hands-on production experience with AWS (preferred), Azure, or GCP.
- Proficiency with AI-assisted engineering tools (Cursor, GitHub Copilot, Claude Code).
- Familiarity with at least one observability stack (Elastic, Datadog, Splunk, Grafana).
- Experience with API testing (Postman, REST-assured).
- Familiarity with Docker and containerized environments.
- Experience designing test or evaluation workflows for AI systems (LLM output validation, RAG pipeline testing, prompt-based test orchestration).
- Startup or SaaS environment experience.
Responsibilities
- Own CI/CD pipelines that gate releases against AI failure modes (eval regressions, groundedness drift, performance regressions).
- Build observability around AI behavior in production beyond standard infrastructure metrics.
- Design test strategies for workflows that interact with physical hardware (simulator-first, hardware-on-demand).
- Drive AI-assisted engineering practice: tooling, prompt review, and evaluation of AI code suggestions.
- Own platform quality, release reliability, and AI-assisted engineering workflows.
View Full Description & ApplyYou'll be redirected to the employer's site
