Data Engineer (Databricks)
New
A
AddeptoData engineering
Workplace type: remote; Country code: PLFull-TimeMiddle
Salary15,120 - 21,000 PLN per month
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 3 years of commercial experience implementing, developing, or maintaining Big Data systems.
- Required Skills
- PythonSQLApache AirflowMicrosoft Power BIAzureSparkdbtDatabricks
Requirements
- Have at least 3 years of commercial experience implementing, developing, or maintaining Big Data systems.
- Have strong Python programming skills, including clean code and OOP design.
- Have experience designing and implementing data governance and data management processes.
- Be familiar with Big Data technologies such as Airflow or Dagster, Databricks, Spark, and DBT.
- Have experience implementing and deploying solutions in cloud environments; Azure is preferred.
- Know how to build and deploy Power BI reports and dashboards for data visualization.
- Have an excellent understanding of dimensional data and data modeling techniques.
- Have excellent communication skills and consulting experience with direct client interaction.
- Be able to work independently and take ownership of project deliverables.
- Have a master’s or Ph.D. in Computer Science, Data Science, Mathematics, Physics, or a related field.
Responsibilities
- Design scalable streaming and batch data processing pipelines using Big Data technologies such as Databricks, Airflow, and/or Dagster.
- Contribute to the development of CI/CD and MLOps processes.
- Develop applications to aggregate, process, and analyze data from diverse sources.
- Collaborate with the Data Science team on machine learning projects, including text and image analysis and predictive model building.
- Develop and organize data transformations using Databricks, DBT, and Apache Airflow.
- Translate business requirements into technical solutions.
- Ensure optimal performance and quality.
View Full Description & ApplyYou'll be redirected to the employer's site
