AI Infrastructure Operations Engineer

New
P
Private Health ManagementHealthcare technology
This is a remote role requiring that you live in and physically perform all work in the United States.Full-Time
SalaryThe target base salary for this position is $140000 - $160000
Apply NowOpens the employer's application page

Job Details

Required Skills
KubernetesMicrosoft AzureGitHub ActionsHIPAA

Requirements

  • Strong hands-on Kubernetes operations experience, including troubleshooting workloads, admission controllers, cluster networking, and production incidents.
  • Experience supporting cloud-native infrastructure in Azure environments, particularly AKS and related operational tooling.
  • Strength in monitoring, observability, and incident response using structured logging and metrics platforms.
  • An SRE mindset, with experience handling on-call responsibilities, operational prioritization, and post-incident analysis.
  • Ability to operate in fast-moving environments with incomplete documentation, evolving processes, and broad ownership areas.
  • Strong communication and collaboration skills, including explaining technical issues to technical and non-technical audiences.
  • Experience with CI/CD pipeline tooling such as GitHub Actions, Kaniko, cosign, image signing, or Actions Runner Controller is a plus.
  • Familiarity with Infrastructure as Code practices using Bicep or Azure resource automation tooling is a plus.
  • Exposure to HIPAA, SOC2, or other compliance-aware operational environments is a plus.
  • Experience supporting AI or LLM-backed applications in production environments is a plus.

Responsibilities

  • Monitor and maintain AKS infrastructure, AI agent workloads, deployment pipelines, and supporting Azure services.
  • Investigate incidents, troubleshoot production issues, and improve platform resilience through operational patterns and tooling.
  • Support release operations and help keep deployments stable, observable, and recoverable.
  • Develop dashboards, alerts, logging patterns, and operational baselines using Azure Log Analytics and Application Insights.
  • Identify system trends, performance bottlenecks, and operational risks across infrastructure and AI workloads.
  • Improve visibility into AI agent behavior, enterprise workflow integrations, latency patterns, and system health under real user load.
  • Maintain operational practices for dependency updates, CVE remediation, image signing, secrets rotation, and cluster patching.
  • Partner with security and engineering stakeholders on compliance-aware operational practices in a HIPAA-regulated environment.
  • Contribute documentation, operational runbooks, and shared knowledge to reduce platform fragility.
View Full Description & ApplyYou'll be redirected to the employer's site
The target base salary for this position is $140000 - $160000
Apply Now