Senior Data Engineer
New
H
H2B GroupTravel and cruise
Zdalnie (Global)ContractSenior
Salary100 - 140 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- Język angielski na poziomie minimum B2+ / C1
- Required Skills
- PythonSQLSpark
Requirements
- Strong knowledge of Apache Spark and Lakehouse architecture.
- Advanced proficiency in Python and SQL.
- Experience with Microsoft Azure, including Azure Databricks, Azure Data Factory, and Azure Data Lake Storage Gen2.
- Practical experience with Delta Live Tables (DLT) and Unity Catalog.
- Knowledge of Azure Synapse Analytics or Azure Data Explorer.
- Experience building and maintaining CI/CD processes using Azure DevOps and Git.
- Experience with infrastructure automation, monitoring, and log auditing.
- Basic knowledge of Power BI for sharing and consuming data models.
- English proficiency at B2+ / C1 level.
Responsibilities
- Develop and maintain scalable data solutions using Azure Databricks, Azure Synapse Analytics, and Data Lake.
- Implement efficient batch and streaming ETL/ELT pipelines using Python, SQL, and Apache Spark.
- Implement and standardize Unity Catalog, upgrade platform components, and support the move to a Data Lakehouse architecture.
- Build and maintain Databricks Workflows, Delta Live Tables, and metadata-driven frameworks.
- Ensure data correctness, consistency, and security; optimize storage structures and investigate production incidents.
- Optimize Spark compute usage, SQL queries, and cloud infrastructure costs.
- Contribute to Azure DevOps CI/CD pipelines and infrastructure automation; monitor and log system metrics.
- Collaborate with data architects, analysts, and business teams, and promote software engineering practices within the data team.
View Full Description & ApplyYou'll be redirected to the employer's site
