Databricks Data Engineer

New
E
emagine PolskaData engineering
Workplace type: remote; Locations: Warsaw, Centrum, Warsaw, Country code: PLContractSenior
Salary not disclosed
Apply NowOpens the employer's application page

Job Details

Languages
English B1
Required Skills
SQLOracleCI/CDDocumentationDatabricksPySpark

Requirements

  • Have experience with Databricks and building data pipelines.
  • Be proficient in PySpark and SQL.
  • Have a strong understanding of CI/CD processes.
  • Be able to implement data-quality checks and tests.
  • Experience with Delta Lake and data optimization is a plus.
  • Familiarity with Oracle databases is a plus.
  • Knowledge of data governance and documentation practices is a plus.
  • Work on a B2B contract for 32 weeks.

Responsibilities

  • Build bronze, silver, and gold pipelines in PySpark and SQL using agreed patterns.
  • Implement core data products with data contracts, tests, and documentation.
  • Make pipelines idempotent and re-runnable, and handle replay, backfill, and late-arriving data.
  • Deploy through CI/CD with Databricks Asset Bundles, including unit tests and data-quality checks.
  • Tune performance and costs through Delta optimization, liquid clustering, and compute sizing.
  • Reconcile migrated data against Oracle sources.
  • Collaborate with data engineers and document work through runbooks.
View Full Description & ApplyYou'll be redirected to the employer's site
View details
Apply Now