Engenheiro de Dados Sênior
New
Brazil, Standard business hoursContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Portuguese
- Required Skills
- PythonSQLSparkDatabricks
Requirements
- Strong experience as a Data Engineer building scalable data pipelines in cloud environments.
- Advanced knowledge of Azure Data Services including Data Factory, Databricks, Synapse, Azure SQL, Blob Storage, and monitoring tools.
- Experience integrating data through REST/SOAP APIs and working with real-time data ingestion.
- Solid knowledge of relational and non-relational databases such as SQL Server, PostgreSQL, CosmosDB, and MongoDB.
- Proficiency in Python, Spark, SQL, and PowerShell for data processing and automation.
- Experience with DataOps practices, CI/CD pipelines, and Git-based version control.
- Strong understanding of data modeling, query optimization, and database performance tuning.
- Knowledge of data security, governance, and compliance frameworks such as LGPD.
- Ability to communicate clearly and document technical solutions effectively.
Responsibilities
- Design and implement scalable data ingestion pipelines from diverse sources including APIs, relational and non-relational databases, files, and real-time systems.
- Develop and maintain end-to-end data architectures using Azure services such as Data Factory, Databricks, Synapse Analytics, Azure Functions, and related tools.
- Build and manage data lakes, data warehouses, and data marts ensuring reliability, performance, and accessibility of data assets.
- Integrate and consolidate complex datasets across multiple platforms, ensuring consistency, quality, and governance standards.
- Optimize ETL/ELT workflows, monitor performance, and resolve bottlenecks to ensure efficient data processing at scale.
- Collaborate with cross-functional teams including data scientists and business stakeholders to support analytics and AI initiatives.
- Ensure compliance with data security, governance, and regulatory standards such as LGPD.
View Full Description & ApplyYou'll be redirected to the employer's site