Principal AI Engineer
New
S
SonderaAI security
Remote, United States.Full-TimePrincipal
SalaryBase salary of $220,000–$260,000 USD, plus equity.
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonRust
Requirements
- Have shipped LLM-based judges, classifiers, monitors, or agents in production, with evaluations you trusted.
- Build evaluation sets with human labels and report results with their uncertainty.
- Write production code in Python and a systems language.
- Design systems where a model proposes and something else decides.
- Have a public record of research, such as papers, talks, CVEs, or open-source work.
- Use coding agents daily and review their output closely.
- Research on AI control, trusted monitoring, or scalable oversight is a plus.
- Experience with LLM judges for behavior spanning many steps or agents is a plus.
- Experience building systems that learn from reviewers' decisions or mapping controls to frameworks is a plus.
- Red-teaming LLM systems, including prompt injection, is a plus.
- Production Rust experience is a plus.
Responsibilities
- Build labeled evaluations from real agent activity and publish each monitor's precision and recall.
- Run monitors across customer fleets at a predictable cost per trajectory and show which events they have not read.
- Turn patterns across trajectories into policy proposals that cite evidence and are replayed against recent activity.
- Turn denials, approvals, and overrides into proposed refinements.
- Turn simulation failures into proposed repairs.
- Map policies to control frameworks and provide evidence for each mapping.
- Publish or present findings at an ML or security venue.
View Full Description & ApplyYou'll be redirected to the employer's site