Engenheiro de Dados Sênior
New
J
JobgetherSecurity & IT
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLCI/CDData modelingDatabricksGitHubMLOpsPySpark
Requirements
- Strong professional experience with Azure Data Services and Databricks.
- Hands-on experience using Databricks with PySpark for large-scale data processing.
- Experience with Medallion Architecture and modern data-platform patterns.
- Proven experience with MLOps and productionizing machine learning models.
- Strong proficiency in Python and SQL for data engineering workflows.
- Experience implementing CI/CD practices and version control using GitHub.
- Solid knowledge of conceptual, logical, and physical data modeling.
- Experience participating in cloud migration projects involving data platforms.
- Strong background in ETL/ELT development and large volume data integration.
- Experience deploying AI or machine learning models using Azure Machine Learning.
Responsibilities
- Develop, maintain, and optimize ETL/ELT data pipelines in Azure using Databricks for large-scale data processing and integration.
- Design and optimize data models to ensure scalability, performance, consistency, and effective governance.
- Implement CI/CD practices to automate deployments using GitHub.
- Support cloud migration initiatives while ensuring data security and integrity.
- Collaborate with business and data science teams to deploy AI and machine learning models in cloud environments.
- Develop data-quality practices including profiling, monitoring, and validation.
- Support the operationalization of machine learning models using MLOps practices.
View Full Description & ApplyYou'll be redirected to the employer's site
