Senior Data Engineer (Databricks)
New
Warszawa, Ludna, Warszawa, Country code: plFull-TimeSenior
Salary22,000 - 27,000 PLN per month
Apply NowOpens the employer's application page
Job Details
- Languages
- English (B2+)
- Experience
- 5+ years
- Required Skills
- SQLGitSparkCI/CDDatabricksPySpark
Requirements
- 5+ years of commercial experience as a Data Engineer.
- Strong hands-on experience with Databricks.
- Excellent knowledge of Apache Spark and PySpark.
- Very good SQL skills.
- Experience working with Delta Lake.
- Hands-on experience with Azure cloud services (especially Azure Data Lake Storage and Azure Data Factory).
- Experience designing and maintaining modern ETL/ELT pipelines.
- Good understanding of data modeling principles and data warehousing concepts.
- Experience with Git and CI/CD practices.
- Strong communication skills and the ability to work in an Agile environment.
- Professional proficiency in English (B2+).
Responsibilities
- Design, build, and optimize scalable data pipelines using Databricks and Apache Spark.
- Develop and maintain ETL/ELT workflows for large-scale data processing.
- Build and manage data models based on Delta Lake architecture.
- Integrate data from multiple internal and external sources.
- Collaborate with Data Analysts, Data Scientists, and business stakeholders to deliver trusted datasets.
- Ensure data quality, performance, scalability, and reliability across the platform.
- Participate in architecture discussions and contribute to continuous improvements of the data ecosystem.
- Support CI/CD processes and infrastructure best practices.
View Full Description & ApplyYou'll be redirected to the employer's site