Senior Databricks Engineer

New

United StatesFull-TimeSenior

Salary91,000 - 119,000 USD per year

Apply NowOpens the employer's application page

Job Details

Experience: 5+ years of data engineering experience, with 3+ years building production solutions on Databricks and Apache Spark.
Required Skills: AWSSQLGCPAzureSparkCI/CDDatabricksPySpark

5+ years of data engineering experience, with 3+ years building production solutions on Databricks and Apache Spark.
Expert proficiency in Python (PySpark) and advanced SQL.
Deep hands-on experience with Delta Lake, Unity Catalog, and the medallion architecture pattern.
Strong experience with at least one major cloud platform (AWS, Azure, or GCP) and its core data services.
Proven track record optimizing Spark performance and managing cluster cost.
Experience with data modeling, warehousing concepts, and building dimensional/analytics-ready datasets.
Proficiency with Git-based version control, CI/CD, and infrastructure-as-code.
Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.

Architect, build, and maintain scalable ETL/ELT pipelines on the Databricks Lakehouse Platform using PySpark, Spark SQL, and Delta Lake.
Design and implement medallion (bronze/silver/gold) data architectures and enforce data quality, governance, and lineage standards.
Optimize Spark jobs and cluster configurations for performance and cost.
Implement and manage Unity Catalog for access control, data governance, and cross-workspace asset sharing.
Build and orchestrate workflows using Databricks Workflows, Delta Live Tables, and CI/CD pipelines.
Collaborate with data scientists, analysts, and business stakeholders to translate requirements into reliable data products.
Establish engineering best practices, conduct code reviews, and mentor junior data engineers.
Monitor production pipelines, troubleshoot failures, and drive root-cause analysis.

View Full Description & ApplyYou'll be redirected to the employer's site