Senior Data Engineer
New
J
Jimmy TechnologiesBanking Fintech
EEA (European Economic Area)ContractSenior
Salary35,000 - 44,000 EUR per year
Apply NowOpens the employer's application page
Job Details
- Languages
- English
- Required Skills
- DockerPythonSQLKafkaAzureCI/CDDatabricks
Requirements
- Strong SQL skills for ETL, data modeling, and performance tuning.
- Experience in Databricks and Kafka.
- Proficiency in Python, especially for handling and flattening complex JSON structures.
- Extensive experience with Azure cloud services, Azure Event Hub, and real-time data processing technologies including Apache Druid and Apache Storm.
- Understanding of software engineering and testing practices within an Agile environment.
- Experience with Data as Code; version control, small and regular commits, unit tests, CI/CD, and packaging.
- Familiarity with containerization tools such as Docker (must have) and Kubernetes (plus).
- Excellent teamwork and communication skills.
- Proficiency in English, with strong written and verbal communication skills.
Responsibilities
- Implement ETL processes and real-time data pipelines for efficient data handling and integration.
- Develop and maintain scalable, cloud-based data architecture using Azure especially Azure Event Hub and Kafka.
- Implement CI/CD practices to streamline development and deployment processes.
- Employ Docker for containerization and efficient resource management across development environments.
- Gather requirements, set targets, define interface specifications, and conduct design sessions.
- Work closely with data consumers to ensure proper integration.
- Adapt and learn in a fast-paced project environment.
View Full Description & ApplyYou'll be redirected to the employer's site
