Azure Data Engineer with Databricks

New
L
Link GroupData engineering
Workplace type: remote; Locations: Warszawa, Centrum, Warszawa, Country code: PLFull-TimeMiddle
Salary120 - 130 PLN per hour
Apply NowOpens the employer's application page

Job Details

Required Skills
PythonSQLGitAzureData modelingDatabricksAzure DevOpsPySpark

Requirements

  • Have hands-on experience implementing data lakes and pipelines with Databricks and Azure Data Factory.
  • Have proven experience designing and implementing solutions in Azure cloud.
  • Be proficient in SQL and PySpark.
  • Understand data modeling, including 3NF and star/snowflake schemas.
  • Understand ELT/ETL design patterns.
  • Have experience with Python or similar scripting languages for data transformation, orchestration, and automation.
  • Be familiar with Databricks features including Unity Catalog, MLflow, Jobs, and Pipelines.
  • Understand cloud data architecture principles, including Lakehouse concepts, Medallion architecture, API integration, and event-driven architecture.
  • Have experience with CI/CD and DevOps practices for data workflows, including Git and Azure DevOps.
  • Be familiar with analytics integration such as Power BI.
  • Have communication and client-facing skills to explain technical concepts clearly to team members and stakeholders.
  • Have collaboration skills for working across multidisciplinary teams.

Responsibilities

  • Develop and implement scalable data processing solutions on Azure.
  • Transform and clean large structured and unstructured datasets.
  • Design, build, and maintain data pipelines integrating databases, APIs, and streaming platforms.
  • Collaborate with data engineers, data scientists, and cloud architects on end-to-end data platform solutions.
  • Engage with business analysts, source system experts, data architects, engineers, and product owners throughout project development.
  • Communicate and document technical work.
  • Consider performance and cost in design decisions.
View Full Description & ApplyYou'll be redirected to the employer's site
120 - 130 PLN per hour
Apply Now