Databricks Data Engineer
New
E
emagine PolskaData engineering
Workplace type: remote; Locations: Warsaw, Centrum, Warsaw, Country code: PLContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English B1
- Required Skills
- SQLOracleCI/CDDocumentationDatabricksPySpark
Requirements
- Have experience with Databricks and building data pipelines.
- Be proficient in PySpark and SQL.
- Have a strong understanding of CI/CD processes.
- Be able to implement data-quality checks and tests.
- Experience with Delta Lake and data optimization is a plus.
- Familiarity with Oracle databases is a plus.
- Knowledge of data governance and documentation practices is a plus.
- Work on a B2B contract for 32 weeks.
Responsibilities
- Build bronze, silver, and gold pipelines in PySpark and SQL using agreed patterns.
- Implement core data products with data contracts, tests, and documentation.
- Make pipelines idempotent and re-runnable, and handle replay, backfill, and late-arriving data.
- Deploy through CI/CD with Databricks Asset Bundles, including unit tests and data-quality checks.
- Tune performance and costs through Delta optimization, liquid clustering, and compute sizing.
- Reconcile migrated data against Oracle sources.
- Collaborate with data engineers and document work through runbooks.
View Full Description & ApplyYou'll be redirected to the employer's site