Kafka Platform Engineer
New
B
Bright Vision TechnologiesTechnology Consulting
100% Remote (U.S.)Full-TimeSenior
Salary130,000 - 180,000 USD per year
Apply NowOpens the employer's application page
Job Details
- Experience
- 10+ Years
- Required Skills
- KubernetesApache KafkaPrometheusTerraformAnsibleDistributed Systems
Requirements
- Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related technical discipline.
- 10+ years of professional experience in distributed systems, platform engineering, or infrastructure engineering.
- 5+ years of hands-on Apache Kafka or Confluent Platform experience.
- Expert-level knowledge of Kafka internals including partitions, replication, brokers, ISR, consumer groups, offset management, and performance tuning.
- Extensive experience implementing Kafka security using SASL, SSL/mTLS, ACLs, RBAC, and enterprise authentication mechanisms.
- Strong hands-on experience with Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, and real-time event streaming architectures.
- Experience implementing High Availability (HA), Disaster Recovery (DR), multi-cluster replication, and cross-region failover strategies.
- Advanced scripting skills using Python, Bash, or Go.
- Experience with Infrastructure as Code using Terraform, Ansible, or similar tools.
- Strong experience with observability platforms including Prometheus, Grafana, OpenTelemetry, ELK, and distributed tracing solutions.
- Excellent troubleshooting, communication, documentation, stakeholder management, and technical leadership skills.
Responsibilities
- Architect, deploy, and manage highly available Apache Kafka and Confluent Platform environments supporting enterprise-scale event-driven applications.
- Design Kafka cluster topology, broker configuration, partitioning strategies, replication, capacity planning, and performance optimization for high-throughput workloads.
- Implement enterprise-grade security using SASL, SSL/mTLS, ACLs, RBAC, encryption, and authentication mechanisms.
- Design and manage Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, and event streaming pipelines for real-time data integration.
- Develop and maintain Infrastructure as Code using Terraform, Ansible, or similar automation frameworks to provision and manage Kafka infrastructure.
- Design and implement High Availability (HA), Disaster Recovery (DR), backup, failover, and cross-region replication strategies.
- Build comprehensive monitoring, alerting, logging, and observability solutions using Prometheus, Grafana, OpenTelemetry, ELK, and Confluent monitoring tools.
- Support Kafka deployments on Kubernetes using Strimzi, Confluent Operator, or managed cloud services.
- Collaborate with stakeholders to establish event-driven architecture standards and mentor engineers.
View Full Description & ApplyYou'll be redirected to the employer's site
