Senior Data Developer
New
C
CI&TPharmaceutical data
BrazilFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Native Portuguese and Advanced English for technical documentation.
- Required Skills
- PythonSQLSparkDatabricks
Requirements
- Have solid data engineering experience, including production pipelines.
- Have advanced SQL and Python skills.
- Have advanced Databricks skills, including Spark, Delta Lake, jobs, and workflows.
- Have experience integrating CRM and Data Lake through APIs, connectors, and files; Veeva experience is strongly preferred.
- Have experience with automated data quality testing, monitoring, and reconciliation.
- Have experience calculating and governing metrics, including definition, versioning, and reconciliation with analytics tools.
- Have experience applying LGPD to personal data, including minimization, pseudonymization, retention, and data subject rights.
- Be a native Portuguese speaker and have advanced English for technical documentation.
Responsibilities
- Design and implement batch and streaming ETL/ELT pipelines between CRM, Data Lake, and Adobe Experience Platform, including profile, segment, and event export.
- Model analytical tables in the Databricks Data Lake and calculate engagement and business indicators.
- Implement data quality testing, alerting, source reconciliation, and identity deduplication handling.
- Apply LGPD through data classification, pseudonymization, retention and deletion policies, audit trails, and data subject request fulfillment.
- Support the architect with XDM modeling and source-data identity strategy.
- Document pipelines, the data dictionary, and lineage, and maintain operational runbooks.
- Sustain production pipelines and investigate data incidents.
View Full Description & ApplyYou'll be redirected to the employer's site
