Senior Master Data Developer
New
C
CI&TData Engineering
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLGCPAirflowBigQueryPySpark
Requirements
- Strong hands-on technical depth in Python, PySpark, and advanced SQL for large-scale distributed data processing.
- Robust experience migrating data lakes and refactoring legacy code into modular cloud-native components.
- Practical mastery of the Google Cloud data engineering ecosystem (BigQuery, Dataform, Dataflow, Dataproc Serverless).
- Solid understanding of Medallion Architecture (Raw/Bronze, Silver/Trusted Core, Gold).
- Experience with analytical data modeling strategies (Star Schema, One Big Table).
- Hands-on experience with modern GitOps development flows and code review processes.
- Proficiency in orchestration automation using Airflow or Cloud Composer.
- Maturity in data quality practices with testing applied directly to pipelines.
- Consultative and collaborative communication skills for cross-team alignment.
Responsibilities
- Translate legacy Databricks notebook logic into modern ELT patterns using declarative SQL and Python-based distributed processing.
- Preserve data contracts during migration using trusted-core layering and reverse-view strategies.
- Build scalable ingestion pipelines using parameterized YAML and automated DAG generation.
- Apply synchronous and unit-level assertions to enforce data quality standards.
- Execute technical migration validation projects to reconcile data output between legacy and new environments.
- Manage GitOps development flows including feature branches, pull requests, and CI/CD pipelines.
- Collaborate with Data Stewards to align dependencies and validate migration outcomes.
View Full Description & ApplyYou'll be redirected to the employer's site
