Senior Data Engineer (Databricks)
New
E
Entrada AIData Engineering
Greece, Poland, RomaniaFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent English (C1+)
- Experience
- 5–7+ years in Data Engineering or distributed systems
- Required Skills
- AWSPythonSQLAzureSparkdbtDatabricksPySpark
Requirements
- 5–7+ years in Data Engineering or distributed systems.
- At least 3 years of deep, hands-on experience specifically within the Databricks ecosystem, including Delta Lake internals.
- Advanced proficiency in Python and SQL.
- Production experience in Azure (ADLS Gen2, ADF) or AWS (S3, Glue).
- Expertise in implementing Unity Catalog.
- Familiarity with dbt or Delta Live Tables (DLT) for modern data orchestration.
- Experience or interest in building data applications using Databricks Apps and utilizing engine features like Photon and Liquid Clustering.
- Strong understanding of data modeling, metadata management, and data quality frameworks.
- Fluent English (C1+) for direct client collaboration.
- Commitment to technical excellence, ideally backed by Databricks Certifications (e.g., Data Engineer Professional).
Responsibilities
- Design and implement scalable data pipelines using Apache Spark (PySpark) on Databricks.
- Migrate legacy data warehouses to the Lakehouse architecture using Delta Lake.
- Analyze and optimize complex Spark jobs for performance and cost using Photon engine and partitioning techniques.
- Enforce high code quality through rigorous code reviews and CI/CD implementation using Databricks Asset Bundles.
- Ensure security and data governance via Unity Catalog.
- Share knowledge with the internal team and act as a strategic technical advisor for clients.
View Full Description & ApplyYou'll be redirected to the employer's site
