Senior Data Engineer (Databricks)
New
100% Remote (Poland)Full-TimeSenior
Salary26,880 - 35,280 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Fluent English (C1+)
- Experience
- 5+ years in Data Engineering; Minimum 3 years of hands-on experience with the Databricks platform
- Required Skills
- AWSPythonSQLGCPAzureSparkCI/CDdbtDatabricksPySpark
Requirements
- 5+ years in Data Engineering with a strong focus on distributed systems.
- Minimum 3 years of hands-on experience with the Databricks platform. You understand the internals of Delta Lake.
- Production experience with Azure (ADLS Gen2, ADF) or AWS (S3, Glue).
- Advanced proficiency in Python and SQL.
- Experience with Unity Catalog implementation.
- Fluent English (C1+) is mandatory for direct client collaboration.
- Experience building data applications using Databricks Apps (nice to have).
- Familiarity with Delta Live Tables (DLT) (nice to have).
- Databricks Certifications (Data Engineer Professional) (nice to have).
- Experience with dbt (nice to have).
Responsibilities
- Design and implement scalable data pipelines using Apache Spark (PySpark) on Databricks.
- Analyze and optimize complex Spark jobs for performance and cost (partitioning, z-ordering, Photon engine utilization).
- Migrate legacy data warehouses to the Lakehouse architecture using Delta Lake.
- Enforce high code quality standards through rigorous code reviews and CI/CD implementation (Databricks Asset Bundles).
- Share knowledge with the team and act as a technical advisor for clients.
View Full Description & ApplyYou'll be redirected to the employer's site
