Senior Data Engineer (Python, Confluent Cloud, Kafka)
New
1
1deaData engineering
100% zdalnieContractSenior
Salary155 - 175 PLN per hour
Apply NowOpens the employer's application page
Job Details
- Languages
- English C1, Polish C2
- Required Skills
- PythonSQLGCPMongoDBApache KafkaData modeling
Requirements
- Have practical data engineering experience with Python.
- Have advanced SQL knowledge and experience optimizing queries.
- Know Apache Kafka and the Confluent Cloud platform.
- Have solid knowledge of data modeling and data warehouses.
- Experience with event-driven architecture is preferred.
- Knowledge of CDC tools is preferred.
- Experience with GCP is preferred.
- Knowledge of MongoDB is preferred.
- A Confluent Cloud certification is an advantage, but is not required.
Responsibilities
- Design and develop real-time data streaming pipelines using Apache Kafka and Confluent Cloud.
- Create and optimize ETL/ELT processes and data-processing scripts in Python.
- Write and optimize advanced SQL queries.
- Model analytical data and design data warehouse structures, including star and snowflake schemas and Slowly Changing Dimensions.
- Configure and integrate data sources using CDC tools and databases such as MongoDB.
- Help design and implement event-driven systems in the GCP cloud environment.
- Maintain the performance, scalability, and reliability of data-processing systems.
- Establish technical standards within the team.
View Full Description & ApplyYou'll be redirected to the employer's site