Senior Data Engineer (Databricks)
New
M
Massive RocketData Engineering
Anywhere in UKContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- English proficiency at C1 level
- Experience
- 5+ years
- Required Skills
- PythonSQLAgileSparkDatabricksPySpark
Requirements
- 5+ years of experience in Data Engineering with strong hands-on experience building production data pipelines.
- Deep experience with Databricks, including Spark, PySpark, Structured Streaming, Delta Lake, and both batch and near real-time processing.
- Strong Python, SQL, and data modelling skills, with experience designing scalable data architectures.
- Proven experience integrating complex upstream or legacy data sources with downstream Martech, CDP, or customer engagement platforms.
- Strong understanding of customer data concepts including identity resolution, unified customer profiles, deduplication, enrichment, and audience management.
- Experience working with CDPs or customer engagement platforms, particularly mParticle and/or Braze.
- Strong understanding of data quality, governance, privacy, consent management, and handling customer PII.
- Experience with cloud platforms such as AWS, Azure, or GCP, alongside Git and CI/CD practices.
- Experience working in an agency, consultancy, or client-facing environment within Agile delivery teams.
- English proficiency at C1 level.
Responsibilities
- Design and maintain scalable batch and near real-time data pipelines in Databricks, integrating data from legacy systems, POS, web, app, and CRM.
- Build unified customer profiles and support identity resolution, deduplication, enrichment, and Golden Record creation.
- Design and optimise data flows from Databricks through mParticle and into Braze to power customer journeys and audience activation.
- Develop automated data quality, validation, governance, and monitoring frameworks to ensure reliable and compliant customer data.
- Enable CRM and marketing teams to access trusted, activation-ready audiences with minimal latency.
- Manage customer consent and PII across data flows, ensuring compliance with GDPR and CCPA/CPRA.
- Troubleshoot integration issues and optimise data infrastructure costs.
- Provide technical guidance through code reviews, mentoring, and documentation.
View Full Description & ApplyYou'll be redirected to the employer's site
