Senior Backend Engineer - AI Agents
New
United StatesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- AWSDockerSQLKubernetesgRPCNosqlRESTful APIsDistributed Systems
Requirements
- 5+ years of experience in backend engineering, distributed systems, or platform engineering
- Strong experience building high-scale, production-grade backend systems
- Experience designing systems for real-time processing, streaming, or event-driven architectures
- Strong understanding of API design (REST, gRPC) and microservices architectures
- Experience with databases (SQL + NoSQL) and data modeling for high-scale systems
- Hands-on experience with Docker, Kubernetes, and cloud platforms (AWS/GCP/Azure)
- Strong fundamentals in system design, concurrency, and performance optimization
Responsibilities
- Design and build scalable backend systems powering AI Agents that operate in real-time enterprise environments
- Develop agent orchestration frameworks (multi-step reasoning, tool usage, decisioning workflows)
- Build systems for agent memory, context management, and state persistence across interactions
- Architect low-latency inference pipelines integrating LLMs, SLMs, and external tools/services
- Implement evaluation (evals) frameworks to measure agent performance, accuracy, and reliability
- Enable continuous improvement loops (feedback → retraining → deployment) for AI agents in production
- Design and manage event-driven, asynchronous workflows for complex agent tasks
- Optimize systems for high throughput, low latency, and cost-efficient inference at scale
- Build and maintain robust APIs and service layers (REST / gRPC) for agent capabilities
- Partner closely with Applied AI / ML teams to productionize models and agent behaviours.
View Full Description & ApplyYou'll be redirected to the employer's site
