Senior Software Engineer, SRE and Production Engineering - DGX Cloud
New
J
JobgetherAI infrastructure
Fully remote work arrangement in Canada.Full-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 12 years of experience building software for or operating production infrastructure, including substantial hands-on bare-metal experience.
- Required Skills
- PythonKubernetesGoLinux
Requirements
- At least 12 years of experience building software for or operating production infrastructure, including substantial hands-on bare-metal experience.
- Strong programming skills in Go or Python and a track record of delivering production automation and services.
- Direct experience using BMC and Redfish interfaces for server provisioning, hardware health inspection, power management, or fault diagnosis.
- Practical experience with NVIDIA GPU hardware, particularly NVL72 systems, and BlueField-3 or newer DPUs.
- Strong knowledge of Linux, firmware and driver management, network boot processes, and server lifecycle operations.
- Experience with on-call responsibilities, incident response, observability, and implementation of durable reliability solutions.
- Ability to troubleshoot issues across hardware, host operating systems, networking, and distributed services.
- Bachelor's or Master's degree in Computer Science, or equivalent practical experience.
- Advantageous: experience operating BlueField DPUs in DPU mode, including host-to-DPU connectivity and lifecycle troubleshooting.
- Advantageous: familiarity with NVLink, InfiniBand, Spectrum-X, or GPU cluster performance validation.
- Advantageous: experience designing workflows for rack-scale deployment, firmware upgrades, hardware replacement, and customer handoffs.
- Advantageous: knowledge of Kubernetes, GitOps, Argo CD, Service Level Objectives (SLOs), and fleet-wide automation.
Responsibilities
- Develop automation for bare-metal server provisioning, hardware validation, firmware and software upgrades, repairs, and cluster lifecycle management.
- Build tools that use BMC and Redfish interfaces to monitor hardware health, manage server states, and support recovery workflows.
- Operate and advance NVIDIA NVL72 systems and BlueField-3 or newer DPUs across cloud partner and on-premises environments.
- Diagnose and resolve failures involving servers, DPUs, GPU and CPU systems, networking, Linux, and Kubernetes.
- Turn recurring infrastructure issues into automated detection, troubleshooting, and repair processes.
- Define validation procedures and production handoff criteria for introducing infrastructure capacity.
- Participate in on-call rotations, incident response, root-cause investigations, and follow-up corrective work.
- Collaborate with hardware, networking, platform engineering, data center operations, and partner teams to resolve issues.
- Improve reliability, operational consistency, and automation across the production fleet.
View Full Description & ApplyYou'll be redirected to the employer's site
