Principal AI Engineer

New
S
SonderaAI security
Remote, United States.Full-TimePrincipal
SalaryBase salary of $220,000–$260,000 USD, plus equity.
Apply NowOpens the employer's application page

Job Details

Required Skills
PythonRust

Requirements

  • Have shipped LLM-based judges, classifiers, monitors, or agents in production, with evaluations you trusted.
  • Build evaluation sets with human labels and report results with their uncertainty.
  • Write production code in Python and a systems language.
  • Design systems where a model proposes and something else decides.
  • Have a public record of research, such as papers, talks, CVEs, or open-source work.
  • Use coding agents daily and review their output closely.
  • Research on AI control, trusted monitoring, or scalable oversight is a plus.
  • Experience with LLM judges for behavior spanning many steps or agents is a plus.
  • Experience building systems that learn from reviewers' decisions or mapping controls to frameworks is a plus.
  • Red-teaming LLM systems, including prompt injection, is a plus.
  • Production Rust experience is a plus.

Responsibilities

  • Build labeled evaluations from real agent activity and publish each monitor's precision and recall.
  • Run monitors across customer fleets at a predictable cost per trajectory and show which events they have not read.
  • Turn patterns across trajectories into policy proposals that cite evidence and are replayed against recent activity.
  • Turn denials, approvals, and overrides into proposed refinements.
  • Turn simulation failures into proposed repairs.
  • Map policies to control frameworks and provide evidence for each mapping.
  • Publish or present findings at an ML or security venue.
View Full Description & ApplyYou'll be redirected to the employer's site
Base salary of $220,000–$260,000 USD, plus equity.
Apply Now