Staff AI Engineer - AI Infrastructure & Agentic Platform
S
ShiftKeyHealthcare Tech Platform
United States, Should be comfortable working asynchronously and partnering with teammates in different time zones.Full-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years of professional software engineering experience, with at least 2 years building and operating production AI/LLM application systems
- Required Skills
- AWSPythonTypeScriptGoTerraformLLMHIPAA
Requirements
- 7+ years of professional software engineering experience.
- 2+ years building and operating production AI/LLM application systems.
- Deep expertise in retrieval engineering (hybrid search, re-ranking, query transformation, context-window management).
- Experience with agentic frameworks and multi-step reasoning loops.
- Production-grade engineering fluency in Go, Python, or TypeScript.
- Hands-on experience operating AI workloads on managed cloud platforms (AWS Bedrock preferred).
- Proficiency with Terraform for independent infrastructure provisioning.
- Familiarity with production observability, metrics, and evaluation harnesses for AI.
- Understanding of HIPAA-style data-handling requirements in a regulated environment.
Responsibilities
- Evolve the AI knowledge platform, scaling retrieval, indexing, and synthesis layers.
- Architect and operate multi-step agentic infrastructure on AWS with integrated cost guardrails.
- Design and build graph-based, relationship-aware retrieval systems for multi-hop queries.
- Partner with product engineering to define the AI platform API surface and developer abstractions.
- Build reference agent implementations for operational-incident triage and customer support.
- Own the AI infrastructure cost model, monitoring spend and implementing guardrails.
View Full Description & ApplyYou'll be redirected to the employer's site
