Data Developer (Azure/Databricks) Senior
New
C
CI&TTechnology Services
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLAzureCI/CDDatabricksGitHubPySpark
Requirements
- Solid experience with Azure Data Services and Databricks.
- Experience with PySpark.
- Knowledge of Medallion architecture.
- Proficiency in Python and SQL for data manipulation.
- Experience with CI/CD and versioning using GitHub.
- Knowledge of analytical data modeling (ingestion, preparation, consumption layers).
- Experience in cloud migration projects.
- Experience with ETL/ELT and large-volume data integration.
- Experience with AI model deployment and tools like Azure ML.
- Experience with AI projects and pipeline automation.
Responsibilities
- Develop and maintain ETL/ELT data pipelines in Azure using Databricks.
- Maintain a 360-degree view of project impacts and solutions.
- Implement CI/CD practices for deployment automation and code versioning using GitHub.
- Model and evolve tables in Unity Catalog with schema versioning.
- Design and optimize data models for scalability, performance, and governance.
- Support cloud migration projects ensuring security and data integrity.
- Collaborate with business and data science teams to deploy AI models in cloud environments.
- Ensure data quality and consistency using data profiling and monitoring.
- Document processes, architectures, and data engineering best practices.
View Full Description & ApplyYou'll be redirected to the employer's site
