Middle Data Engineer
New
Canada, Germany, India, United Kingdom, United StatesFull-TimeMiddle
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Languages
- Upper-intermediate or higher level of English
- Experience
- 3+ years of experience in back end
- Required Skills
- SQLJavaApache KafkaJSONScala
Requirements
- 3+ years of experience in back end.
- Commercial experience in software engineering with strong proficiency in Java (Scala is a plus).
- Understanding of Apache Kafka architecture and internals.
- Experience working with Apache Flink.
- Experience with Schema Registry and schema evolution strategies.
- Knowledge of serialization formats such as Avro and JSON.
- Experience using SQL for processing large datasets.
- Upper-intermediate or higher level of English.
Responsibilities
- Build and maintain data pipelines using Apache Kafka, including topics, partitions, and consumer group tuning.
- Implement and manage Kafka Connect source and sink connectors for integrations.
- Design and develop stateful streaming applications using Kafka Streams or Flink with Java (and Scala where applicable).
- Ensure data consistency and schema evolution using Schema Registry (Avro).
- Write and maintain unit and integration tests for streaming topologies.
View Full Description & ApplyYou'll be redirected to the employer's site
