Staff Data Engineer
New
J
JobgetherData Engineering
Based in United StatesFull-TimeStaff
SalaryBase salary ranging from $175,000 to $218,000 USD
Apply NowOpens the employer's application page
Job Details
- Experience
- 12+ years
- Required Skills
- PythonSQLCloud ComputingAirflowDistributed Systems
Requirements
- Bachelor’s degree in Computer Science or equivalent professional experience.
- 12+ years of experience building and operating large-scale data systems.
- Deep expertise in distributed data systems, data architecture, and secure, governed data platforms.
- Strong hands-on experience with Apache Iceberg or comparable table formats such as Delta Lake or Hudi.
- Advanced proficiency in Python and SQL.
- Experience designing data orchestration patterns using tools such as Airflow.
- Strong experience working in at least one major cloud environment (AWS, GCP, or Azure).
- Familiarity with infrastructure-as-code and automated platform management.
- Strong understanding of batch, streaming, and event-driven architectures.
- Proven experience as a senior technical leader influencing cross-functional teams.
Responsibilities
- Design and evolve an Iceberg-based lakehouse architecture with a focus on scalability, performance, cost efficiency, and maintainability.
- Establish technical standards for table design, partitioning, schema evolution, optimization, and data layout across the data platform.
- Lead complex architectural initiatives spanning batch, streaming, and event-driven data processing.
- Define and implement shared approaches for metadata, dataset documentation, data lineage, governance, and cataloging.
- Design and evolve secure data access models, including table-, column-, and row-level controls.
- Build automation for compaction, retention, lifecycle management, and cost optimization.
- Mentor senior and mid-level engineers and provide technical guidance.
View Full Description & ApplyYou'll be redirected to the employer's site
