Senior Data Engineer / Tech Lead (Spark)
New
A
AddeptoAI Consulting
Warszawa, Krucza 50, Kraków, Aleksandra Lubomirskiego 20, Wrocław, Świdnicka 40, Katowice, -, Gdańsk, -, Warszawa, Country code: PLFull-TimeSenior
Salary21,000 - 28,560 PLN per month
Apply NowOpens the employer's application page
Job Details
- Languages
- English (at least C1 level)
- Experience
- 4 years
- Required Skills
- DockerPostgreSQLPythonSQLApache AirflowKubernetesData engineeringSpark
Requirements
- At least 4 years of commercial experience in Data Engineering or Big Data projects.
- Strong programming skills in Python.
- Very good knowledge of SQL.
- Strong hands-on experience with Apache Spark and distributed data processing.
- Practical experience with workflow orchestration tools, preferably Apache Airflow.
- Experience with Apache Iceberg and/or modern lakehouse architectures.
- Experience working with Docker and Kubernetes.
- Good understanding of data modelling, data pipelines, and data processing architectures.
- Experience working with relational databases and/or query engines such as PostgreSQL or Trino.
- General understanding of cloud environments and cloud-based data solutions.
- Fluent English (at least C1 level).
- Bachelor’s degree in technical or mathematical studies.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, SQL, Spark, and Airflow.
- Build and improve data processing solutions based on Apache Iceberg and modern lakehouse architectures.
- Take technical ownership of selected areas and contribute to technical and architectural decisions.
- Combine hands-on development with technical leadership and knowledge sharing within the team.
- Build and maintain containerized workloads using Docker and Kubernetes.
- Ensure data pipelines are scalable, reliable, maintainable, and production-ready.
- Collaborate with engineers and other stakeholders to translate requirements into effective solutions.
- Contribute to engineering best practices including code quality, testing, CI/CD, and automation.
- Monitor, troubleshoot, and improve existing data pipelines and platform components.
View Full Description & ApplyYou'll be redirected to the employer's site
