Senior Data Engineer

New

MARGOData engineering

Listing location: Warsaw; Workplace type: Remote; Structured job location: WarsawFull-TimeSenior

Salary180 - 200 PLN per hour

Apply NowOpens the employer's application page

Job Details

Have 6+ years of experience in data engineering.
Bring strong Python skills, including PySpark.
Have advanced SQL skills.
Have hands-on experience with Azure-based data platforms.
Have experience with Databricks and Unity Catalog.
Have experience with Apache Airflow and Azure Data Factory.
Have experience with reporting and BI tools such as Power BI, Tableau, or similar.
Understand data modeling fundamentals, architectures, and design patterns.
Understand Data Warehouse, Data Lake, and Data Lakehouse architectures.
Understand Medallion and metadata-driven architectures.
Understand ETL/ELT design patterns.
Understand partitioning, optimization, and performance.
Understand batch and streaming pipelines.

Implement scalable, reliable, reusable data pipelines using Azure Data Factory and Apache Airflow.
Develop PySpark and SQL transformations in Azure Databricks to create and extend data products across Bronze, Silver, and Gold Medallion Architecture layers.
Optimize the performance, cost, and reliability of data workloads.
Raise questions during business maturation to identify risks before development.
Participate in architecture reviews and technical decision-making.
Promote engineering practices through code reviews and design reviews.
Collaborate with Architects and Product Owners on technical maturation of data products.
Support the Run/Operations team with production pipelines and data products, and troubleshoot data incidents and performance issues.
Participate in incident management, root cause analysis, and post-mortems.
Document and hand over solutions, ensure operational readiness, and improve runbooks, monitoring, and operational processes.

View Full Description & ApplyYou'll be redirected to the employer's site