Director of Infrastructure Engineering
New
R
RunpodAI Infrastructure
Remote - USAFull-TimeDirector
Salary($225,000 - $325,000)
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years leading teams, 8+ years building distributed systems
- Required Skills
- KubernetesTerraformNetworkingAnsibleDistributed Systems
Requirements
- 7+ years leading software, infrastructure, SRE, or networking teams, including managing managers.
- 8+ years building and operating large-scale distributed systems, bare-metal infrastructure, or public/private cloud platforms.
- Proven architectural understanding of ultra-low latency networking (InfiniBand and/or RoCE).
- Deep familiarity with spine-leaf architectures and global WAN routing protocols (BGP).
- Experience building, operating, or tuning high-performance distributed storage systems and parallel file systems (e.g., Ceph, Lustre, Weka, NVMe-oF).
- Strong foundation in SRE/DevOps practices, infrastructure-as-code (Terraform, Ansible), and container orchestration (Kubernetes).
- Experience building culture, accountability, and momentum across remote-first technical teams.
- Clear written and verbal communication, strong stakeholder management, and decisive leadership during operational incidents.
- Successful completion of a background check.
Responsibilities
- Lead multiple engineering teams responsible for Site Reliability Engineering, networking, and storage.
- Establish rigorous SRE practices, driving SLA/SLO definitions, incident response, observability, and automated remediation.
- Oversee the design, scaling, and operation of Runpod’s global network backbone, as well as ultra-low-latency HPC cluster networks.
- Drive the implementation and optimization of InfiniBand and RDMA over Converged Ethernet (RoCE) to support massive, multi-node GPU training workloads.
- Direct the architecture and performance tuning of highly scalable, distributed storage systems.
- Hire, mentor, and grow highly technical engineering managers and senior ICs.
- Partner with Program Management and Product to forecast capacity requirements and shape technical roadmaps.
- Drive measurable improvements in infrastructure reliability and delivery metrics.
- Provide architectural oversight for bare-metal provisioning, virtualization layers, and network fabrics.
View Full Description & ApplyYou'll be redirected to the employer's site
