Staff Storage Platform Engineer (AI Storage)
New
R
Radian ArcAI infrastructure
This is a fully remote role, we will consider relevant candidates in all locations.Full-TimeStaff
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonBash
Requirements
- Strong hands-on experience designing and operating distributed storage systems for high-performance compute environments.
- Experience designing storage architectures for large-scale AI inference or training, including dataset distribution, checkpointing, and KV-cache storage patterns.
- Deep knowledge of the Linux storage and I/O stack.
- Strong understanding of AI workload data-access patterns and GPU-accelerated workloads.
- Experience operating large-scale storage clusters.
- Knowledge of storage hardware, NVMe devices, storage fabrics, and high-performance data paths.
- Experience designing storage observability systems.
- Strong automation skills using Python and/or Bash.
- Experience applying software engineering practices to storage automation and operational tooling.
- Ability to lead complex technical initiatives and set architectural direction across teams.
- Ability to debug cross-layer issues involving storage, networking, Linux kernel and I/O paths, filesystems, object and block storage, Kubernetes integrations, and distributed workloads.
- Familiarity with Kubernetes storage integrations such as CSI.
Responsibilities
- Design scalable AI storage architectures for edge and core deployments.
- Define storage strategies for distributed inference, fine-tuning, and training workloads.
- Optimize storage throughput, latency, and data locality for GPU-heavy clusters.
- Benchmark storage performance under real AI workloads and establish validation methods.
- Implement and maintain CSI drivers and integrate storage platforms with Kubernetes and orchestration systems.
- Design storage approaches for KV-cache persistence, dataset distribution, checkpointing, and model artifact delivery.
- Lead performance investigations across hardware, networking, operating systems, filesystems, and workloads.
- Improve storage reliability, durability, observability, and operational practices.
- Lead storage infrastructure delivery from architecture and validation through production rollout.
- Guide cross-functional teams on storage architecture and mentor engineers.
View Full Description & ApplyYou'll be redirected to the employer's site
