Sr./Staff Backend Engineer - Kafka

8+ years of experience with Java in large-scale, distributed environments. Extensive experience with Apache Kafka, including Kafka Streams, Kafka Connect, partitioning, replication, and consumer group management. Strong experience with AWS services (e.g., MSK, EC2, RDS, DynamoDB, S3, Lambda). Solid understanding of distributed system design, messaging patterns, and eventual consistency. Proven ability to diagnose and resolve bottlenecks in streaming and database systems. Proficiency with Postgres, Redis, ClickHouse, and DynamoDB. Knowledge of event-driven architecture and streaming patterns. Hands-on experience with monitoring tools (e.g., Prometheus, Grafana, Kafka Manager). Experience automating infrastructure with tools like Terraform or CloudFormation. Familiarity with encryption, role-based access control, and secure API development.

Design, develop, and maintain scalable backend services using Java and AWS. Lead architecture, deployment, and optimization of Apache Kafka. Build and manage Kafka topics, brokers, producers, and consumers. Implement streaming solutions with Kafka Streams and Kafka Connect. Collaborate with product, frontend, and data engineering teams. Design and maintain high-performance data storage solutions using Postgres, Redis, ClickHouse, and DynamoDB. Optimize database performance through schema design and indexing. Implement best practices for infrastructure security and monitoring. Establish and maintain CI/CD pipelines. Provide mentorship to junior engineers and conduct code reviews. Proactively identify and resolve performance bottlenecks.