Real-Time Data Engineer
New
B
Bright Vision TechnologiesSoftware Development
100% Remote (U.S.)Full-TimeSenior
Salary135,000 - 160,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years
- Required Skills
- PythonBashApache KafkaGoTerraformAnsible
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- 6+ years of total professional experience.
- 5+ years of experience operating Apache Kafka or Confluent Platform in production.
- Deep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
- Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC).
- Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
- Experience with HA/DR strategies for Kafka.
- Strong scripting skills in Python, Bash, or Go.
- Hands-on experience with infrastructure-as-code (Terraform, Ansible).
- Working knowledge of observability tooling for Kafka.
- Excellent troubleshooting, communication, and documentation skills.
Responsibilities
- Architect, deploy, and operate large-scale Apache Kafka and Confluent platform environments supporting mission-critical event-driven workloads.
- Manage the Kafka platform end-to-end, including cluster sizing, configuration, security, automation, and observability.
- Enable developers to leverage the streaming platform effectively through documentation and support.
- Partner with cross-functional teams including product, design, engineering, and operations to translate requirements into technical solutions.
- Perform code and design reviews while providing mentorship to junior engineers.
- Ensure platform reliability and performance while maintaining high engineering standards in production environments.
View Full Description & ApplyYou'll be redirected to the employer's site
