Azure Data Engineer with Databricks
New
L
Link GroupData engineering
Workplace type: remote; Locations: Warszawa, Centrum, Warszawa, Country code: PLFull-TimeMiddle
Salary120 - 130 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLGitAzureData modelingDatabricksAzure DevOpsPySpark
Requirements
- Have hands-on experience implementing data lakes and pipelines with Databricks and Azure Data Factory.
- Have proven experience designing and implementing solutions in Azure cloud.
- Be proficient in SQL and PySpark.
- Understand data modeling, including 3NF and star/snowflake schemas.
- Understand ELT/ETL design patterns.
- Have experience with Python or similar scripting languages for data transformation, orchestration, and automation.
- Be familiar with Databricks features including Unity Catalog, MLflow, Jobs, and Pipelines.
- Understand cloud data architecture principles, including Lakehouse concepts, Medallion architecture, API integration, and event-driven architecture.
- Have experience with CI/CD and DevOps practices for data workflows, including Git and Azure DevOps.
- Be familiar with analytics integration such as Power BI.
- Have communication and client-facing skills to explain technical concepts clearly to team members and stakeholders.
- Have collaboration skills for working across multidisciplinary teams.
Responsibilities
- Develop and implement scalable data processing solutions on Azure.
- Transform and clean large structured and unstructured datasets.
- Design, build, and maintain data pipelines integrating databases, APIs, and streaming platforms.
- Collaborate with data engineers, data scientists, and cloud architects on end-to-end data platform solutions.
- Engage with business analysts, source system experts, data architects, engineers, and product owners throughout project development.
- Communicate and document technical work.
- Consider performance and cost in design decisions.
View Full Description & ApplyYou'll be redirected to the employer's site