AI Infrastructure Operations Engineer
New
P
Private Health ManagementHealthcare technology
This is a remote role requiring that you live in and physically perform all work in the United States.Full-Time
SalaryThe target base salary for this position is $140000 - $160000
Apply NowOpens the employer's application page
Job Details
- Required Skills
- KubernetesMicrosoft AzureGitHub ActionsHIPAA
Requirements
- Strong hands-on Kubernetes operations experience, including troubleshooting workloads, admission controllers, cluster networking, and production incidents.
- Experience supporting cloud-native infrastructure in Azure environments, particularly AKS and related operational tooling.
- Strength in monitoring, observability, and incident response using structured logging and metrics platforms.
- An SRE mindset, with experience handling on-call responsibilities, operational prioritization, and post-incident analysis.
- Ability to operate in fast-moving environments with incomplete documentation, evolving processes, and broad ownership areas.
- Strong communication and collaboration skills, including explaining technical issues to technical and non-technical audiences.
- Experience with CI/CD pipeline tooling such as GitHub Actions, Kaniko, cosign, image signing, or Actions Runner Controller is a plus.
- Familiarity with Infrastructure as Code practices using Bicep or Azure resource automation tooling is a plus.
- Exposure to HIPAA, SOC2, or other compliance-aware operational environments is a plus.
- Experience supporting AI or LLM-backed applications in production environments is a plus.
Responsibilities
- Monitor and maintain AKS infrastructure, AI agent workloads, deployment pipelines, and supporting Azure services.
- Investigate incidents, troubleshoot production issues, and improve platform resilience through operational patterns and tooling.
- Support release operations and help keep deployments stable, observable, and recoverable.
- Develop dashboards, alerts, logging patterns, and operational baselines using Azure Log Analytics and Application Insights.
- Identify system trends, performance bottlenecks, and operational risks across infrastructure and AI workloads.
- Improve visibility into AI agent behavior, enterprise workflow integrations, latency patterns, and system health under real user load.
- Maintain operational practices for dependency updates, CVE remediation, image signing, secrets rotation, and cluster patching.
- Partner with security and engineering stakeholders on compliance-aware operational practices in a HIPAA-regulated environment.
- Contribute documentation, operational runbooks, and shared knowledge to reduce platform fragility.
View Full Description & ApplyYou'll be redirected to the employer's site