Distributed Systems ML Infrastructure Engineer
New
O
OpenTeamsArtificial Intelligence
Washington, DC; Denver, CO; or Colorado Springs, CO preferred (hybrid). Highly qualified candidates outside these locations may also be considered for unclassified work.Full-TimeSenior
Salary145,000 - 250,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years of experience in distributed systems, platform engineering, infrastructure engineering, or a related software engineering role
- Required Skills
- PythonKubernetesMachine LearningGoTerraformHelmDistributed Systems
Requirements
- 6+ years of experience in distributed systems, platform engineering, infrastructure engineering, or a related software engineering role.
- Production experience operating Kubernetes and containerized workloads on a major cloud platform.
- Experience with managed Kubernetes services such as Amazon EKS.
- Experience supporting machine learning workloads in production, such as model serving, GPU scheduling, or large-scale data and evaluation pipelines.
- Experience designing, building, or operating distributed services that support reliability, scalability, and performance requirements.
- Proficiency in Python, Go, or a comparable programming language.
- Experience with infrastructure-as-code and deployment tools such as Terraform or Helm.
- Experience designing API-first services and implementing documented interface specifications.
- Experience testing platform capacity and performance against expected workload requirements.
- Ability to document technical interfaces, deployment procedures, architectural decisions, and validation results.
- Bachelor’s degree in computer science, engineering, or a related field, or equivalent practical experience.
Responsibilities
- Design and implement platform services for workflow orchestration, data ingest, and results management, exposed through documented APIs.
- Implement and operate model gateway and serving services that route invocations with policy enforcement, usage accounting, and audit logging.
- Maintain a provider abstraction to support multi-cloud and dedicated environment deployments.
- Deploy platform releases into classified host environments, integrate data sources, and execute validation procedures.
- Verify environment parity after each promotion.
- Size and validate the platform against workload models and perform load testing.
- Gate development-only dependencies and ensure dependencies are available in target environments.
- Reproduce high-side defects on the low side for troubleshooting.
View Full Description & ApplyYou'll be redirected to the employer's site
