Data Engineer (Databricks)

New
A
AddeptoData engineering
Locations: Warszawa, Krucza 50, Kraków, Aleksandra Lubomirskiego 20, Wrocław, Świdnicka 40, Katowice, -, Gdańsk, -, Warszawa, Country code: PLFull-TimeMiddle
Salary15120 - 21000 PLN per month net b2b
Apply NowOpens the employer's application page

Job Details

Experience
At least 3 years of commercial experience implementing, developing, or maintaining Big Data systems.
Required Skills
PythonApache AirflowMicrosoft Power BIAzureSparkData modelingdbtDatabricks

Requirements

  • Have at least 3 years of commercial experience implementing, developing, or maintaining Big Data systems.
  • Bring strong Python programming skills, including clean code and object-oriented design.
  • Have experience designing and implementing data governance and data management processes.
  • Be familiar with Big Data technologies such as Databricks, Spark, Kafka, Airflow, Dagster, or dbt.
  • Have experience implementing and deploying solutions in cloud environments; Azure is preferred.
  • Know how to build and deploy Power BI reports and dashboards for data visualization.
  • Have a strong understanding of dimensional data and data modeling techniques.
  • Have communication skills and consulting experience involving direct client interaction.
  • Be able to work independently and take ownership of project deliverables.
  • Hold a master's or Ph.D. in Computer Science, Data Science, Mathematics, Physics, or a related field.

Responsibilities

  • Design scalable data processing pipelines for streaming and batch processing using Big Data technologies such as Databricks, Airflow, or Dagster.
  • Contribute to the development of CI/CD and MLOps processes.
  • Develop applications to aggregate, process, and analyze data from diverse sources.
  • Collaborate with the Data Science team on machine-learning projects, including text and image analysis and predictive model building.
  • Develop and organize data transformations using Databricks, dbt, and Apache Airflow.
  • Translate business requirements into technical solutions and ensure optimal performance and quality.
View Full Description & ApplyYou'll be redirected to the employer's site
15120 - 21000 PLN per month net b2b
Apply Now