Senior Software Engineer, Backend (AI Platform)
New
A
AffirmAI platform
Location: Remote USFull-TimeSenior
SalaryUSA base pay range (CA, WA, NY, NJ, CT) per year: $195,000 - $255,000; USA base pay range (all other U.S. states) per year: $173,000-233,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years of experience designing, developing and launching backend systems at scale
- Required Skills
- AWSPythonKotlinKubernetesMySQL
Requirements
- Have 4+ years of experience designing, developing, and launching backend systems at scale.
- Have experience using languages such as Python or Kotlin.
- Have a track record developing highly available distributed systems.
- Have experience with technologies such as AWS, MySQL, and Kubernetes.
- Have practical production experience building with LLMs, agents, or AI frameworks.
- Have experience with inference APIs, LLM gateways such as LiteLLM, MCP, tool calling, evals, or agent runtimes.
- Understand AI usage and the infrastructure needed to support AI workloads.
- Have experience defining technical plans and delivering significant features or system components with simple, extensible designs.
- Write high-quality code that is easy for others to understand and use.
- Be proficient in making significant changes safely in a large codebase.
- Have a bachelor's degree in a related field or equivalent practical experience.
Responsibilities
- Plan, execute, and own technical decisions and projects within the AI Platform team, from design through launch and on-call.
- Design and build gateway, runtime, and evaluation services for AI workloads, scaling them securely across users and transactions.
- Build identity, quota, routing, caching, and failover controls for AI models and tools.
- Partner with security, infrastructure, and product engineering teams to define guardrails for agentic workloads and tool-access identity.
- Create and monitor system metrics, and own monitoring, alerting, runbooks, and on-call.
- Set and improve code review and design standards, and advocate for them through writing and tech talks.
- Use AI tools and agentic workflows in code, design review, and operations.
- Educate and mentor engineers and drive design, coding, and testing best practices.
View Full Description & ApplyYou'll be redirected to the employer's site
