Senior Data Engineer
New
C
Ceox Services LtdData engineering
Source API remote eligibility restrictions: United KingdomContractSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLMicrosoft Power BIPySpark
Requirements
- Strong experience with Python, PySpark, and SQL for data engineering.
- Hands-on experience with Azure Databricks.
- Strong knowledge of Azure Data Factory and Fabric.
- Experience with Microsoft Purview.
- Familiarity with event-driven data ingestion, including Event Grid or Pub-Sub.
- Understand SOLID principles, asynchronous programming, and Mediator/Factory patterns.
- Experience delivering unit and integration testing in Databricks.
- Knowledge of secure ETL design with Entra IMID/SCIM integration.
- Understand Azure best practices, APIM, and platform governance.
- Ability to build and serve Power BI models via Databricks data sources.
- Prior experience in UK public sector environments is desirable.
Responsibilities
- Build and maintain ETL pipelines and code in cloud data platforms.
- Support ingestion activities and onboard new data sources.
- Develop Data Engineering workloads using the Databricks Data Intelligence Platform.
- Construct raw, refined, and curated data layers and catalogue assets.
- Validate solutions against functional and non-functional requirements.
- Deliver datasets, transformations, and performance-optimised data products.
- Improve processes, engineering patterns, and reusable tooling.
- Monitor pipeline performance and support incident resolution.
- Ensure documentation meets acceptance standards and is approved centrally.
- Participate in Agile ceremonies and governance forums.
View Full Description & ApplyYou'll be redirected to the employer's site
