Senior Data Engineer (Databricks)
New
A
AddeptoData engineering
Locations: Warszawa, Krucza 50, Kraków, Aleksandra Lubomirskiego 20, Wrocław, Świdnicka 40, Katowice, -, Gdańsk, -, Warszawa, Country code: PLFull-TimeSenior
Salary21000 - 28560 PLN per month net b2b
Apply NowOpens the employer's application page
Job Details
- Experience
- At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
- Required Skills
- PythonSQLApache AirflowMicrosoft Power BIApache KafkaAzureSparkdbtDatabricks
Requirements
- At least 5 years of commercial experience implementing, developing, or maintaining Big Data systems.
- Strong Python programming skills, including clean code and object-oriented design.
- Strong SQL skills, including performance tuning, query optimization, and experience with data warehousing solutions.
- Experience designing and implementing data governance and data management processes.
- Deep expertise in Big Data technologies, including Databricks, Spark, Kafka, EventHub, Airflow, and Dagster.
- Experience implementing and deploying solutions in cloud environments, preferably Azure.
- Knowledge of building and deploying Power BI reports and dashboards for data visualization.
- Excellent understanding of dimensional data and data modeling techniques.
- Consulting experience and ability to guide clients on architecture, technology selection, and best practices.
- Ability to work independently and take ownership of project deliverables.
- Master’s or Ph.D. in Computer Science, Big Data, Mathematics, Physics, or a related field.
Responsibilities
- Design and optimize scalable data processing pipelines for streaming and batch workloads using Databricks, Apache Airflow, and Dagster.
- Architect and implement end-to-end data platforms with high availability, performance, and reliability.
- Lead the development of CI/CD and MLOps processes for deployments, monitoring, and model lifecycle management.
- Develop and maintain applications for aggregating, processing, and analyzing data from diverse sources.
- Collaborate with Data Science teams on machine learning projects, including feature engineering and predictive model deployment.
- Design and manage data transformations using Databricks, DBT, and Apache Airflow.
- Translate business requirements into scalable technical solutions while ensuring performance and data quality.
- Ensure data security, compliance, and governance best practices across data pipelines.
View Full Description & ApplyYou'll be redirected to the employer's site