Mid Data Developer (Azure + Databricks)
C
CI&TTechnology Services
BrazilFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- GitMicrosoft SQL ServerData engineeringSparkCI/CDDevOpsDatabricksPySpark
Requirements
- Experience with data engineering.
- Experience in production environments.
- Experience working with large volumes of data.
- Participation in migration, modernization, or data lake construction projects.
- Ability to investigate incidents and perform root cause analysis.
Responsibilities
- Construct, maintain, and optimize robust data pipelines focusing on low latency, resilience, data quality, and observability.
- Develop scalable data routes using Apache Spark / PySpark and Databricks with efficient partitioning and cost optimization strategies.
- Structure and manage data using SQL Server and Delta Lake.
- Apply Git version control, create CI/CD routines for automated deployments, and monitor production routines.
- Investigate failures, perform root cause analysis, and act on continuous improvement for production routines.
View Full Description & ApplyYou'll be redirected to the employer's site
