Data Engineer (Azure)
New
Costa RicaFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLETLGitMicrosoft SQL ServerData modelingAzure DevOpsPySpark
Requirements
- Bachelor’s degree in Computer Science, Information Technology, or equivalent work experience.
- Proven experience in ETL data engineering using Python (PySpark).
- Expertise in extracting data from REST APIs, SQL databases, and CSV files.
- Proficiency with Azure Synapse Analytics (Notebooks, Pipelines, Linked Services, Azure Key Vault).
- Ability to write and optimize complex SQL queries for SparkSQL and MS SQL.
- Experience with version control systems like Git (Azure DevOps).
- Strong problem-solving, analytical, and communication skills.
- Azure Data Engineer certification is a plus.
- Experience with big data technologies, machine learning, and data analysis is preferred.
- Familiarity with Power BI, Tableau, and Agile methodologies is a plus.
Responsibilities
- Develop and maintain ETL processes using Python (PySpark) within Azure Synapse Analytics.
- Design and build data storage structures in MPP SQL Pools using star schemas, facts, and dimensions.
- Extract data from REST APIs, SQL database tables, and CSV files.
- Optimize data pipelines and notebooks for scalability, performance, and reliability.
- Implement data quality checks and validation processes to ensure accuracy.
- Collaborate with data architects on data modeling and schema design.
- Monitor ETL jobs and maintain documentation of data flows and transformations.
View Full Description & ApplyYou'll be redirected to the employer's site
