Director of Infrastructure Engineering
New
R
RunpodAI Infrastructure
Remote - USAFull-TimeDirector
Salary$225,000 - $325,000
Apply NowOpens the employer's application page
Job Details
- Experience
- 7+ years leading teams; 8+ years building and operating large-scale distributed systems
- Required Skills
- KubernetesTerraformAnsibleDistributed Systems
Requirements
- 7+ years leading software, infrastructure, SRE, or networking teams, including managing managers and multiple squads.
- 8+ years building and operating large-scale distributed systems, bare-metal infrastructure, or public/private cloud platforms.
- Deep architectural understanding of ultra-low latency networking, InfiniBand, and/or RoCE.
- Experience with spine-leaf architectures and global WAN routing protocols (BGP).
- Experience building, operating, or tuning high-performance distributed storage systems (e.g., Ceph, Lustre, Weka, NVMe-oF).
- Strong foundation in reliability engineering, infrastructure-as-code (Terraform, Ansible), and container orchestration (Kubernetes).
- Experience building culture and accountability across distributed technical teams.
- Clear written and verbal communication and strong stakeholder management skills.
- Successful completion of a background check.
Responsibilities
- Lead multiple engineering teams responsible for Site Reliability Engineering, networking, and storage.
- Establish rigorous SRE practices, driving SLA/SLO definitions, incident response, observability, and automated remediation.
- Oversee the design, scaling, and operation of Runpod’s global network backbone and ultra-low-latency HPC cluster networks.
- Drive the implementation and optimization of InfiniBand and RDMA over Converged Ethernet (RoCE) for GPU workloads.
- Direct the architecture and performance tuning of scalable, distributed storage systems for high IOPS and throughput.
- Hire, mentor, and grow technical engineering managers and senior individual contributors.
- Partner with Product and Program Management to forecast capacity, shape roadmaps, and convert scale challenges into milestones.
View Full Description & ApplyYou'll be redirected to the employer's site
