Senior Engineering Manager, AI Quality & Governance
New
This role can be performed 100% remote anywhere in the US.Full-TimeManager
Salary$210K – $230K Annually USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 8+ years
- Required Skills
- AWSPythonTypeScriptLLM
Requirements
- 8+ years of software engineering experience including leading engineers as a manager or technical lead.
- Hands-on experience building, shipping, or operating production AI systems, ideally LLM-powered or agentic workflows.
- Strong experience designing and operating production backend systems and APIs.
- Experience with AI observability, evaluation, or debugging systems (e.g., LangSmith, LangFuse).
- Practical experience designing or operating AI guardrails such as content filtering, redaction, or access controls.
- Familiarity with AI governance and risk frameworks such as NIST AI RMF or ISO/IEC 42001.
- Ability to engage thoughtfully with legal, compliance, and security stakeholders.
- Strong bias toward hands-on execution and platform thinking.
- Proficiency in Python and TypeScript.
- Familiarity with cloud environments like AWS or OCI.
Responsibilities
- Own the AI evaluations and observability platform including tracing, logs, dashboards, and operational feedback loops.
- Design and operationalize automated and human-in-the-loop evaluation strategies for quality, safety, and latency.
- Establish standards for production-ready AI, including release gates, incident playbooks, and quality metrics.
- Build and operate AI guardrails such as content controls, PII detection, and audit logging.
- Translate governance and risk expectations into scalable engineering systems.
- Own platform-level SLOs and provide tier-two incident support for AI behavior issues.
- Act as an internal authority on AI quality and governance and support customer-facing communications.
- Hire, mentor, and grow the AI Quality & Governance team.
View Full Description & ApplyYou'll be redirected to the employer's site
