Sr Staff - Data Platform Engineer

New
USFull-TimeStaff
Salary220,000 USD to 255,800 USD annually
Apply NowOpens the employer's application page

Job Details

Experience
15+ years
Required Skills
AWSPythonJavaKubernetesSpring BootAzureSparkTerraform

Requirements

  • 15+ years of software engineering experience with strong focus on distributed systems and platform engineering.
  • At least 4+ years in Staff or Principal-level engineering roles leading large-scale platform initiatives.
  • Strong computer science fundamentals including system design, algorithms, and data structures.
  • Advanced software engineering experience in Java (Spring Boot, microservices) and Python, with emphasis on production-grade systems.
  • Proven experience building data platforms, APIs, or frameworks—not limited to ETL or dashboard development.
  • Deep expertise in data lakehouse technologies such as Apache Iceberg, Hudi, or Delta Lake.
  • Experience with large-scale distributed data processing frameworks such as Spark or similar open-source ecosystems.
  • Strong background in cloud infrastructure (AWS or Azure), including services like S3, EMR, Kubernetes, and Lambda.
  • Hands-on experience with CI/CD, Terraform, Git-based workflows, and modern DevOps practices.
  • Exposure to AI-native development workflows, including LLM-assisted engineering and automation of SDLC tasks.
  • Proven ability to lead through influence across multiple engineering teams and organizational boundaries.
  • Strong communication skills with ability to explain complex architectural trade-offs to both executives and engineers.

Responsibilities

  • Define and own the long-term architectural vision and 3–5 year roadmap for the enterprise data platform and lakehouse ecosystem.
  • Design and build platform-as-a-product capabilities, including internal SDKs, APIs, CLI tools, and orchestration frameworks.
  • Architect scalable data systems that integrate storage, compute, and metadata layers using modern lakehouse technologies.
  • Develop abstractions and control planes that simplify infrastructure complexity for downstream data and software engineers.
  • Prototype, evaluate, and integrate emerging technologies to improve performance, scalability, and cost efficiency.
  • Design and implement governance-by-design systems, including data lineage, security controls, and PII protection mechanisms.
  • Enable real-time and streaming data ingestion pipelines, including AI and telemetry-driven data sources.
  • Lead architectural reviews and serve as the escalation point for complex system design and production issues.
  • Establish engineering best practices and drive code quality, scalability, and system reliability standards across teams.
  • Mentor engineers and influence the broader data engineering organization, including hiring standards and technical growth paths.
View Full Description & ApplyYou'll be redirected to the employer's site
220,000 USD to 255,800 USD annually
Apply Now