Senior Data Engineer
New
E
emagine PolskaSustainability data
Workplace type: remote; Locations: Warsaw, Centrum, Warsaw, Country code: PLContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- En B1
- Experience
- 5+ years of experience in data engineering and data platforms.
- Required Skills
- SQLGitCI/CDData modelingDatabricksPySpark
Requirements
- Have 5+ years of experience in data engineering and data platforms.
- Bring strong production experience with Databricks.
- Have expert knowledge of PySpark, SQL, data modelling, and data pipeline design.
- Have experience with CI/CD, Git, automated testing, and deployment.
- Know data quality, governance, lineage, and auditing.
- Have strong troubleshooting and root-cause analysis skills.
- Be able to take ownership and deliver pragmatic, production-ready solutions.
- Be available for business trips to Denmark from time to time.
- The engagement is for 12 months, with an option for extension.
Responsibilities
- Design and develop data pipelines and data products using Databricks, Delta Lake, and PySpark.
- Build data models and transformation frameworks for large and complex datasets.
- Develop data quality controls, validation, and reconciliation processes.
- Optimize pipelines for performance, scalability, and cost.
- Implement CI/CD, automated testing, and deployment processes.
- Support data governance, lineage, security, and access management.
- Work with Sustainability, Business, Product, and Reporting teams.
- Troubleshoot issues, perform root-cause analysis, and ensure reliable production delivery.
- Develop Databricks-based tools to simplify data access and reporting.
View Full Description & ApplyYou'll be redirected to the employer's site