Senior Software Engineer, Data Pipeline
B
BloomreachData pipelines
We work remotely first (from Central & Eastern Europe)Full-TimeSenior
SalaryBase Salary Range 1 296 000 Kč—1 620 000 Kč CZK
Apply NowOpens the employer's application page
Job Details
- Required Skills
- PythonSQLGCPKubernetesMongoDBApache KafkaGoPySpark
Requirements
- Have experience with Python.
- Have a solid grasp of engineering practices.
- Have experience with ETL pipelines and large-scale data ingestion.
- Have experience working with connectors to SQL and non-SQL sources.
- Be able to clean, sanitize, and transform data before loading it into optimized storage for a use case.
- Go experience is a significant advantage.
- Be able to learn and adapt while exploring new technology, navigating a codebase, and iterating on team processes.
- Be able to work in a remote-first environment.
Responsibilities
- Develop reliable, high-throughput data pipelines using Python, Go, MongoDB, and GCP.
- Improve workers, monitoring, and infrastructure autoscaling for real-time tracking traffic.
- Improve the throughput and reliability of imports handling millions of rows of data.
- Implement integrations with additional data storage systems.
- Export platform data to Google BigQuery using DataFlow, PySpark, and Apache Beam.
- Run and support production services handling high-volume traffic with Google Cloud Platform and Kubernetes.
- Review peers’ code and participate in code reviews.
- Participate in the on-call rotation as needed.
View Full Description & ApplyYou'll be redirected to the employer's site