Junior Data Engineer (Azure Databricks)

New

MiratechIT Services, Consulting

SpainFull-TimeJunior

Salary not disclosed

Apply NowOpens the employer's application page

Job Details

Experience: 2+ years of experience in Data Engineering, Data Warehouse development, or a related field
Required Skills: ETLMicrosoft Power BIMicrosoft SQL ServerPySpark

2+ years of experience in Data Engineering, Data Warehouse development, or a related field.
Experience with Azure Databricks.
Experience developing data pipelines using PySpark and Spark SQL.
Understanding of distributed data processing and big data concepts.
Good SQL skills and experience with SQL Server relational databases.
Experience building data pipelines using Azure Data Factory.
Exposure to data processing and performance optimization concepts.
Knowledge of Spark optimization techniques (partitioning, caching, cluster tuning) is a plus.
Familiarity with Power BI and Databricks Structured Streaming is a plus.
Experience in migrating from traditional ETL process to cloud architectures is a plus.
Familiarity with Delta Lake and Lakehouse architectures is a plus.
Strong analytical and problem-solving skills.
Good communication and collaboration skills.

Support and evolve existing SQL Server data platforms and ETL solutions.
Develop and maintain data pipelines using Azure Databricks.
Build and optimize data transformations using PySpark and SQL in Databricks.
Develop ETL/ELT pipelines orchestrated through Azure Data Factory.
Integrate data from multiple sources into the data platform and analytical layers.
Maintain data models and data warehouse structures for analytics.
Ensure data quality, scalability, and performance of large-scale data processing pipelines.
Collaborate with BI teams to support Power BI and reporting platforms.
Participate in the implementation of modern cloud-based data architectures under guidance from senior team members.

View Full Description & ApplyYou'll be redirected to the employer's site