Senior Data Engineer (Databricks)

New
A
AddeptoData engineering
Locations: Warszawa, Krucza 50, Kraków, Aleksandra Lubomirskiego 20, Wrocław, Świdnicka 40, Katowice, -, Gdańsk, -, Warszawa, Country code: PLFull-TimeSenior
Salary21000 - 28560 PLN per month net b2b
Apply NowOpens the employer's application page

Job Details

Experience
At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
Required Skills
PythonSQLApache AirflowMicrosoft Power BIApache KafkaAzureSparkdbtDatabricks

Requirements

  • At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
  • Strong Python programming skills, including clean code and object-oriented design.
  • Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.
  • Experience designing and implementing data governance and data management processes.
  • Deep expertise in Big Data technologies, including Databricks, Spark, Kafka, EventHub, Airflow, and Dagster.
  • Experience implementing and deploying solutions in cloud environments, preferably Azure.
  • Knowledge of building and deploying Power BI reports and dashboards for data visualization.
  • Excellent understanding of dimensional data and data modeling techniques.
  • Consulting experience and ability to guide clients on architecture, technology selection, and best practices.
  • Ability to work independently and take ownership of project deliverables.
  • Master’s or Ph.D. in Computer Science, Big Data, Mathematics, Physics, or a related field.

Responsibilities

  • Design and optimize scalable data processing pipelines for streaming and batch workloads using Databricks, Apache Airflow, and Dagster.
  • Architect and implement end-to-end data platforms with high availability, performance, and reliability.
  • Lead the development of CI/CD and MLOps processes for deployments, monitoring, and model lifecycle management.
  • Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources.
  • Collaborate with Data Science teams on machine learning projects, including feature engineering and predictive model deployment.
  • Design and manage data transformations using Databricks, DBT, and Apache Airflow.
  • Translate business requirements into scalable technical solutions while ensuring performance and data quality.
  • Ensure data security, compliance, and governance best practices across data pipelines.
View Full Description & ApplyYou'll be redirected to the employer's site
21000 - 28560 PLN per month net b2b
Apply Now