Data Engineer (Azure)
New
Remote, Latin America; Source API remote eligibility restrictions: NicaraguaFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLETLGitMicrosoft SQL ServerData modelingAzure DevOpsPySpark
Requirements
- Bachelor’s degree in Computer Science, Information Technology, or related field, or equivalent experience.
- Proven experience in ETL data engineering using Python (PySpark).
- Proficiency in Azure Synapse Analytics including Notebooks, Pipelines, Linked Services, and Azure Key Vault.
- Demonstrated ability to write complex SQL queries, optimize query performance, and work with SparkSQL and MS SQL.
- Experience with version control systems such as Git (Azure DevOps).
- Strong problem-solving, analytical, and communication skills.
- Knowledge of data integration best practices.
- Familiarity with big data technologies, machine learning, and data analysis preferred.
- Experience with data visualization tools (Power BI, Tableau) and Agile methodologies is a plus.
- Relevant certifications (e.g., Azure Data Engineer) are a plus.
Responsibilities
- Develop and maintain ETL data engineering processes using Python (PySpark) within Azure Synapse Analytics Notebooks and Pipelines.
- Design and build effective data storage structures using star schemas, facts, and dimensions in an MPP SQL Pool.
- Extract data from various sources including REST APIs, SQL database tables, and CSV files.
- Collaborate with data architects to create data models and schemas that align with business requirements.
- Implement data quality checks and validation processes to maintain data accuracy and consistency.
- Monitor ETL jobs, diagnose issues, and optimize pipeline performance to meet SLAs.
- Maintain comprehensive documentation of data engineering processes, flows, and transformations.
View Full Description & ApplyYou'll be redirected to the employer's site
