Senior Software Engineer, Quality

New

JobgetherAI testing

Based in United StatesFull-TimeSenior

SalaryU.S. annual total target cash compensation ranging from $143,800 to $231,900

Apply NowOpens the employer's application page

Job Details

Bring 5+ years of professional software engineering experience and a strong track record of writing and shipping production software.
Have hands-on experience building and owning test infrastructure, developer tooling, internal platforms, or comparable systems used by other engineers.
Have practical experience with LLMs or agent frameworks, including prompt and context design, tool use, non-deterministic behavior, and evaluation of AI-generated outputs.
Have a strong understanding of distributed systems and continuous integration at scale, including concurrency, state, timing, and system reliability.
Be able to influence engineering teams without direct management authority and demonstrate successful adoption of tools or practices across teams.
Be willing and able to use and understand the product deeply enough to build effective quality solutions.
Apply strong engineering judgment to balance quality, maintainability, delivery speed, and practical business needs.
Collaborate and communicate effectively in a distributed, cross-functional environment.
Preferred: experience with LLM evaluation or benchmarking, open-source software development, or developer tooling and platform engineering.
Java, TypeScript, or Python, as well as Kubernetes and Helm, are advantageous.

Build and operate AI agents for test design, generation, maintenance, execution, and failure triage.
Own the infrastructure for dependable agent-driven testing, including test environments, test data, tool interfaces, guardrails, runtime management, and cost controls.
Establish methods for evaluating agent output quality so engineering teams can trust automated results.
Apply AI-driven evaluation practices to testing the platform’s non-deterministic and AI-powered capabilities.
Work with product engineering teams as features are developed to keep testing tools relevant to product needs.
Develop reusable testing patterns, tooling, and enablement practices that help engineers own quality independently.
Drive adoption of quality engineering capabilities across teams.
Contribute to technical decisions, system design, and continuous improvement of testing infrastructure and engineering practices.

View Full Description & ApplyYou'll be redirected to the employer's site