Senior Data Engineer
New
A
All Your BILogistics Technology
Fully remote, within Europe.Full-TimeSenior
SalaryEUR 85000 - 99000 / year inclusive of holiday allowance
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- PostgreSQLPythonSQLKafkaMicrosoft SQL ServerAzureGo
Requirements
- 5+ years of data engineering experience with end-to-end ownership of production platforms.
- Strong proficiency in SQL and Python.
- Solid experience with SQL Server as a source system and PostgreSQL as a target store.
- Experience building and operating ELT pipelines with watermark/incremental or CDC-based extraction.
- Experience with event-driven or streaming architectures (e.g., Azure Event Hubs/Kafka).
- Cloud data platform experience on Azure.
- Familiarity with AKS, Azure DevOps CI/CD, and GitOps/Argo CD is a plus.
- Strong focus on data correctness and instrumentation (e.g., OpenTelemetry).
- Go programming experience is a significant plus.
Responsibilities
- Design and build ELT pipelines moving data from terminal operating systems (e.g., Navis N4) into the platform.
- Develop transformation layers to convert raw operational data into curated datasets.
- Implement multi-tenant data architecture on Azure PostgreSQL with database-per-tenant isolation.
- Extend internal connector tooling written in Go.
- Manage data quality monitoring, including gap detection, freshness alerting, and reconciliation.
- Map source data from various TOS versions onto shared definitions for moves, calls, and equipment events.
View Full Description & ApplyYou'll be redirected to the employer's site
