Senior Data Engineer - AWS / Databricks
New
D
DateonicData engineering
Workplace type: remote; Locations: Warszawa, Wrocław, Kraków, Gdańsk, Poznań, Country code: PLContractSenior
Salary160 - 190 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- En B2
- Required Skills
- AWSPythonSQLApache AirflowSparkData modelingdbtDatabricks
Requirements
- Bring strong hands-on experience with Apache Spark, Delta Lake, and production-grade batch and streaming pipeline development.
- Have advanced programming skills in Python and SQL.
- Have a solid grasp of data modelling, data quality, and governance principles.
- Demonstrate hands-on experience with the Databricks Lakehouse Platform, ideally on AWS.
- Have deep technical expertise in at least one major cloud: AWS, GCP, or Azure/Fabric.
- Be open to working across clouds and broadening multi-cloud capabilities.
- Understand distributed systems, lakehouse architectures, scalability, and system performance tuning.
- Be comfortable asking probing questions, challenging assumptions, and collaborating in cross-functional agile teams.
Responsibilities
- Design, implement, and optimise scalable batch, streaming, and near-real-time data platforms using Apache Spark and Delta Lake.
- Build ingestion, transformation, and curation workflows for structured and unstructured data using lakehouse patterns and medallion layering.
- Support cloud-to-cloud migrations, including re-platforming legacy pipelines, data models, and storage layers.
- Deliver production-grade, model-ready datasets and build data pipelines for machine learning, causal modelling, and GenAI use cases.
- Design logical and physical data models and orchestrate automated workflows with Databricks Workflows, Airflow, dbt, or cloud-native equivalents.
- Enforce data governance, lineage, quality frameworks, and access controls using Unity Catalog, AWS Lake Formation, or equivalent tools.
- Monitor data freshness, pipeline reliability, cost efficiency, and SLA compliance.
- Build serving layers and collaborate with data scientists, ML engineers, and business stakeholders on requirements and architecture.
View Full Description & ApplyYou'll be redirected to the employer's site
