Staff Infrastructure Engineer - Data Streaming

Multiple years of experience in infrastructure/platform engineering or DevOps with a proven track record of operating distributed systems at scale. Deep hands-on experience with self-hosted Kafka and/or Redis running in Kubernetes. Strong understanding of Kubernetes internals and best practices for managing stateful and stateless workloads. Exposure to multi-cloud environments with strong expertise in at least one major provider (AWS, GCP, or Azure). Experience with IaC and GitOps practices and tools (Terraform, ArgoCD etc.). Solid understanding of CI/CD pipelines and workflow automation (GitHub Actions, Argo Workflows, etc.). Familiarity with advanced deployment strategies (blue-green, canary, rolling). Strong scripting or development skills (e.g., Python, Go, or similar).

Lead the design & operation of mission-critical distributed data services (Kafka/Redis) at massive scale across Kubernetes. Build automated, self-service infrastructure for complete cloud portability across AWS, GCP, and on-prem. Manage data infrastructure for Petabytes/day ingestion, ensuring low-latency, high-throughput, and cost-effective operation. Consolidate and optimize multi-tenant Kafka clusters. Drive lifecycle automation for distributed data services using GitOps principles. Define and implement standards for observability, HA, backup, and DR. Partner with FinOps and engineering stakeholders to optimize performance, cost, and operational overhead.