Senior Data Engineer (Python, Confluent Cloud, Kafka)

New
1
1deaData engineering
100% zdalnieContractSenior
Salary155 - 175 PLN per hour
Apply NowOpens the employer's application page

Job Details

Languages
English C1, Polish C2
Required Skills
PythonSQLGCPMongoDBApache KafkaData modeling

Requirements

  • Have practical data engineering experience with Python.
  • Have advanced SQL knowledge and experience optimizing queries.
  • Know Apache Kafka and the Confluent Cloud platform.
  • Have solid knowledge of data modeling and data warehouses.
  • Experience with event-driven architecture is preferred.
  • Knowledge of CDC tools is preferred.
  • Experience with GCP is preferred.
  • Knowledge of MongoDB is preferred.
  • A Confluent Cloud certification is an advantage, but is not required.

Responsibilities

  • Design and develop real-time data streaming pipelines using Apache Kafka and Confluent Cloud.
  • Create and optimize ETL/ELT processes and data-processing scripts in Python.
  • Write and optimize advanced SQL queries.
  • Model analytical data and design data warehouse structures, including star and snowflake schemas and Slowly Changing Dimensions.
  • Configure and integrate data sources using CDC tools and databases such as MongoDB.
  • Help design and implement event-driven systems in the GCP cloud environment.
  • Maintain the performance, scalability, and reliability of data-processing systems.
  • Establish technical standards within the team.
View Full Description & ApplyYou'll be redirected to the employer's site
155 - 175 PLN per hour
Apply Now