Engenheiro de Dados Sênior
New
C
CI&TTechnology
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLETLAzureCI/CDData modelingDatabricksGitHubPySpark
Requirements
- Solid experience in Azure Data Services and Databricks.
- Experience with PySpark.
- Experience with Medallion Architecture.
- Proficiency in Python and SQL for data manipulation and transformation.
- Knowledge of CI/CD and versioning with GitHub.
- Knowledge of analytical data modeling (ingestion, preparation, and consumption layers).
- Experience in cloud migration projects.
- Experience with ETL/ELT and large volume data integration.
- Experience with AI model deployment and Azure ML.
- Experience with AI projects and pipeline automation.
Responsibilities
- Develop and maintain data pipelines (ETL/ELT) in Azure using Databricks.
- Implement CI/CD practices for automation and versioning via GitHub.
- Model and evolve tables in Unity Catalog using best practices.
- Design and optimize data models for scalability, performance, and governance.
- Support cloud migration projects ensuring data security and quality.
- Collaborate with business and data science teams for AI model deployment in cloud.
- Ensure data consistency through data profiling and monitoring techniques.
- Document processes, architectures, and data engineering best practices.
View Full Description & ApplyYou'll be redirected to the employer's site
