Data Engineer
New
K
Kitman LabsSports Analytics
Greater Manchester, England, United KingdomFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Required Skills
- DockerPythonSQLGCPGitAirflowCI/CDData modelingBigQuery
Requirements
- Proficiency in writing complex SQL for large datasets in BigQuery.
- Experience with Dataform or dbt, including modular, version-controlled data transformation.
- Strong Python development skills with focus on clean, tested, and linted code.
- Experience with Git and CI/CD workflows.
- Hands-on experience with GCP core services including BigQuery, Cloud Storage, and Cloud Run.
- Experience with orchestration tools like Cloud Composer or Airflow.
- Understanding of data modelling fundamentals such as Kimball principles or medallion architecture.
- Ability to containerise data workloads using Docker.
- Experience with CDC concepts and event-driven ingestion patterns.
- Ability to collaborate effectively across Analytics, Product, and Data Science teams.
Responsibilities
- Build and maintain BigQuery data models using Dataform and medallion architecture patterns.
- Contribute to Looker dashboards and LookML models.
- Write performant, structured SQL for large-scale transformations.
- Implement data quality checks and automated alerting using Dataform assertions.
- Build and maintain robust Python data pipelines with testing, linting, and CI/CD integration.
- Manage workflow orchestration using Cloud Composer or Airflow.
- Develop and containerise workloads with Docker for GCP deployment.
- Support Data Scientists in transitioning research notebooks to production-ready pipelines.
View Full Description & ApplyYou'll be redirected to the employer's site
