Engenheiro de Dados SR
New
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLAzurePySpark
Requirements
- Bachelor's degree in Computer Science, Information Systems, Software Engineering, Computer Engineering, or a related field.
- Solid experience working with Microsoft Azure cloud services.
- Hands-on experience with Azure Databricks, PySpark, Spark SQL, Azure Data Factory (ADF), and Azure Synapse Analytics.
- Strong programming skills in Python and experience developing and maintaining enterprise data pipelines.
- Advanced SQL knowledge, including Spark SQL and T-SQL.
- Experience supporting production environments, monitoring workloads, and resolving operational incidents.
- Solid understanding of data quality, governance, and data integrity principles.
- Knowledge of cloud data architecture, Apache Spark, Data Lakes, Data Warehouses, ETL/ELT processes, and observability.
- Experience with Git or Azure DevOps and Agile methodologies.
- Postgraduate studies or certifications in Data Engineering, Cloud Computing, or Microsoft Azure are considered a plus.
Responsibilities
- Monitor and ensure the availability, stability, and performance of data processing environments.
- Identify, troubleshoot, and resolve production incidents while implementing preventive and corrective actions.
- Design, develop, and optimize scalable data pipelines using Azure Databricks (PySpark and Spark SQL).
- Build and maintain data ingestion and orchestration workflows using Azure Data Factory.
- Develop SQL routines and queries to support data transformation and analytics.
- Validate data quality, integrity, and governance standards across processing pipelines.
- Collaborate with architecture, software engineering, and business teams to implement new data solutions and platform enhancements.
- Document technical solutions, operational procedures, and data workflows.
View Full Description & ApplyYou'll be redirected to the employer's site
