Principal Data Engineering Consultant
New
A
Advancing AnalyticsData engineering
Remote – must be based within the UK.Full-TimePrincipal
Salary£90,000 to £110,000 per annum (depending on experience)
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLMicrosoft AzureSparkTerraformDatabricks
Requirements
- Have a solid understanding of Microsoft Azure and cloud computing concepts.
- Have experience with Apache Spark, such as Databricks, Microsoft Fabric or another Spark engine.
- Use Python to build data solutions.
- Write complex, high-performance SQL queries and understand how queries execute across different compute technologies.
- Have experience with Azure Data Factory or other cloud orchestration tools.
- Understand Azure Data Lake storage and Delta Lake.
- Have experience with Unity Catalog, Purview or other data governance tools.
- Have experience with an infrastructure-as-code tool such as Terraform or Azure DevOps.
- Be able to gather requirements and consult with clients.
- Understand agile project management, including budget and scope management.
- Understand object-oriented development practices, ETL approaches, CI/CD methodologies and SDLC.
Responsibilities
- Deliver data engineering solutions for customer projects.
- Design end-to-end solutions across multiple concurrent projects.
- Gather requirements and consult with clients.
- Balance technical decisions with pragmatic project needs.
- Apply agile project management, including budget and scope management.
- Use ETL approaches that address data quality, resilience and observability.
View Full Description & ApplyYou'll be redirected to the employer's site
