Real-Time Data Engineer
New
B
Bright Vision TechnologiesData Engineering
100% Remote (U.S.)Full-TimeSenior
Salary100,000 - 150,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 6+ years
- Required Skills
- PythonBashApache KafkaGoTerraformAnsible
Requirements
- Bachelor’s degree in Computer Science, Engineering, or a related technical discipline.
- 5+ years of experience operating Apache Kafka or Confluent Platform in production.
- Deep, hands-on knowledge of Kafka internals (partitions, replication, ISRs, consumer groups).
- Strong experience with Kafka security (SASL, mTLS, ACLs, RBAC).
- Hands-on experience with Kafka Connect, Schema Registry, and either Kafka Streams or ksqlDB.
- Experience with HA/DR strategies for Kafka (MirrorMaker 2, Cluster Linking).
- Strong scripting skills in Python, Bash, or Go.
- Hands-on experience with infrastructure-as-code (Terraform, Ansible).
- Working knowledge of observability tooling for Kafka.
- Excellent troubleshooting, communication, and documentation skills.
Responsibilities
- Architect, deploy, and operate large-scale Apache Kafka or Confluent Platform clusters across on-prem and cloud environments.
- Design partitioning, replication, and topic strategies that balance throughput, durability, and operational simplicity.
- Implement strong security on Kafka clusters using SASL, mTLS, ACLs, RBAC, and integration with corporate IdPs.
- Operate Schema Registry, Kafka Connect, KSQL/ksqlDB, and Kafka Streams in production.
- Build CI/CD pipelines for Kafka topic, ACL, and connector configurations using GitOps patterns.
- Drive Kafka cost and capacity optimization through right-sizing and storage tiering.
- Lead incident response and post-incident reviews for streaming workloads.
- Mentor and coach junior and mid-level engineers through code review, design review, and pair programming.
View Full Description & ApplyYou'll be redirected to the employer's site
