Software Engineer (Backend-Focused)
New
A
AZXArtificial Intelligence
Remote but only USA/CanadaFull-TimeSenior
Salary$140K - $225K; $140K – $225K • Offers Equity • Offers Bonus; Range DOE: $140K – $225K • Offers Equity • Offers Bonus
Apply NowOpens the employer's application page
Job Details
- Experience
- 4+ years
- Required Skills
- PythonKubernetesFastAPIGogRPCRustDistributed Systems
Requirements
- 4+ years of experience in backend engineering fundamentals: distributed systems, API design, and production experience in Go, Rust, or async Python.
- Familiarity with LLM-specific backend concerns (rate limiting, caching, token accounting).
- Exposure to Kubernetes and containerization.
- Interest in sandboxing or security.
- Comfort working across a range of platform concerns rather than one narrow specialty.
- Eagerness to grow into deeper specialization in gateway, sandbox, or inference infrastructure over time.
- High emotional intelligence and a learning mindset.
- Strong collaboration skills.
- Comfortable making decisions in the face of ambiguity and course correcting as needed.
Responsibilities
- Build and maintain backend services for our LLM gateway — routing, rate limiting, key management, and observability in front of the inference fleet.
- Contribute to sandboxing and isolation infrastructure that keeps agent-generated code safe to execute.
- Support Kubernetes-based platform services, including operators and autoscaling logic adjacent to our inference platform.
- Write high-performance backend code in Go, Rust, or async Python (FastAPI/Starlette), working with infrastructure like Envoy and gRPC.
- Instrument services with OpenTelemetry so behavior, latency, and cost stay observable as the platform scales.
- Collaborate across the gateway, sandbox, and inference platform teams, flexing across areas as priorities shift.
View Full Description & ApplyYou'll be redirected to the employer's site
