Lead Data Engineer

New
G
GATXData Engineering
United StatesFull-TimeLead
SalaryUSD 111800 - 160000 / year
Apply NowOpens the employer's application page

Job Details

Experience
10+ years of IT experience, including 4-6+ years of recent hands-on experience in designing, building, and scaling data pipelines.
Required Skills
AWSPythonSQLSparkCI/CDDevOpsData modelingDatabricks

Requirements

  • 10+ years of IT experience, including deep expertise in data engineering.
  • 4-6+ years of recent hands-on experience in designing, building, and scaling data pipelines.
  • Strong hands-on experience with Databricks (Spark, Delta Lake, Unity Catalog).
  • Strong hands-on experience with AWS (S3, IAM, networking).
  • Expertise in SQL and Python.
  • Proficiency in data modeling and distributed processing.
  • Experience with CI/CD, DevOps, and modern data architecture (lakehouse, medallion, etc.).
  • Experience working in an Agile analytics environment.
  • Strong communication skills with the ability to translate complex technical concepts.

Responsibilities

  • Design and lead enterprise-grade pipelines, supporting both batch and streaming data processing.
  • Own the full ETL/ELT lifecycle, from design through production support.
  • Drive data engineering standards, best practices, and architecture across the data ecosystem.
  • Translate business requirements into scalable, high-performance data solutions.
  • Mentor a small team while remaining hands-on.
  • Ensure data reliability, performance, governance, and cost optimization.
View Full Description & ApplyYou'll be redirected to the employer's site
USD 111800 - 160000 / year
Apply Now