Head of Infrastructure Operations
New
R
RunwareAI infrastructure
United States, Keep core hours for collaboration and calls.Full-TimeManager
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 15+ years in infrastructure engineering and operations, with at least several of those leading the function at a company that runs its own hardware at scale.
- Required Skills
- LinuxAnsible
Requirements
- Bring 15+ years of infrastructure engineering and operations experience, including several years leading the function at a company operating its own hardware at scale.
- Have built infrastructure operations across multiple sites, regions or countries, including opening data centers, pods or colocation footprints.
- Demonstrate current, hands-on Linux expertise, including kernel and driver behavior, performance tuning, bare-metal provisioning, configuration management and fleet automation.
- Have strong storage fundamentals, including NVMe, distributed and parallel file systems, object storage, throughput and IOPS design.
- Have strong networking fundamentals, including L2/L3 design, BGP, data center fabrics, high-bandwidth interconnects and network troubleshooting.
- Have hired, led and retained engineers and built effective standards, on-call and incident practices.
- Use AI tools for scripting, runbooks, analysis, documentation and debugging, and understand how they can change infrastructure operations.
- Be comfortable making decisions with incomplete information and owning uptime, cost and delivery.
- Be able to travel to sites in the US and Europe as needed.
- Nice to have: experience operating large GPU fleets for AI training or inference, including NVIDIA driver, Fabric Manager and NCCL stacks.
- Nice to have: experience with RDMA fabrics such as InfiniBand or RoCE, 400G+ Ethernet, liquid-cooled or modular data centers, and site-level power and cooling integration.
- Nice to have: familiarity with server ODMs, component lead times, inventory, spares strategy and RMA economics; automation with Ansible, Terraform, PXE, IPMI or Redfish; Prometheus and Grafana; Kubernetes or Slurm on bare metal; or data residency and sovereignty requirements.
Responsibilities
- Build and run infrastructure operations across pod sites in the US and Europe, from site bring-up and rack installation through steady-state operations and decommissioning.
- Own server, storage and network layers, including Linux fleet management, bare-metal provisioning, imaging, firmware and driver lifecycle, and data center and inter-site networks.
- Create a documented, automated playbook for repeatable site deployments.
- Set reliability targets and own capacity planning, monitoring, alerting, on-call, incident response and post-incident reviews.
- Hire, lead and develop data center, systems and network engineers across time zones.
- Manage colocation, power, connectivity and hardware partners, including capacity contracts, lead times, spares, RMA flows and site budgets.
- Partner with hardware and platform engineering to ensure infrastructure designs can be operated at scale and feed field learnings into future servers and pods.
- Use AI and LLM-based agents to automate runbooks, triage and tooling.
- Own operational security and compliance for physical infrastructure, including access control, hardening, asset tracking, audit readiness and data residency.
View Full Description & ApplyYou'll be redirected to the employer's site
