Senior Data Engineer

New
E
emagine PolskaSustainability data
Workplace type: remote; Locations: Warsaw, Centrum, Warsaw, Country code: PLContractSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Languages
En B1
Experience
5+ years of experience in data engineering and data platforms.
Required Skills
SQLGitCI/CDData modelingDatabricksPySpark

Requirements

  • Have 5+ years of experience in data engineering and data platforms.
  • Bring strong production experience with Databricks.
  • Have expert knowledge of PySpark, SQL, data modelling, and data pipeline design.
  • Have experience with CI/CD, Git, automated testing, and deployment.
  • Know data quality, governance, lineage, and auditing.
  • Have strong troubleshooting and root-cause analysis skills.
  • Be able to take ownership and deliver pragmatic, production-ready solutions.
  • Be available for business trips to Denmark from time to time.
  • The engagement is for 12 months, with an option for extension.

Responsibilities

  • Design and develop data pipelines and data products using Databricks, Delta Lake, and PySpark.
  • Build data models and transformation frameworks for large and complex datasets.
  • Develop data quality controls, validation, and reconciliation processes.
  • Optimize pipelines for performance, scalability, and cost.
  • Implement CI/CD, automated testing, and deployment processes.
  • Support data governance, lineage, security, and access management.
  • Work with Sustainability, Business, Product, and Reporting teams.
  • Troubleshoot issues, perform root-cause analysis, and ensure reliable production delivery.
  • Develop Databricks-based tools to simplify data access and reporting.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now