Staff Software Engineer (Streaming Data)

View full description

Requirements:

• 8+ years of relevant experience.
• Proven experience with streaming data pipelines, preferably using Apache Beam or Dataflow.
• Extensive experience with Kafka, Pub/Sub, or similar technologies.
• Experience with large-scale databases like Google Bigtable, including optimizing APIs.
• Expertise in designing table schemas in Bigtable.
• Proficient in Java, Golang, or Rust.
• Experience in a zero-to-one startup environment with a proactive approach to problem-solving.
• Strong SQL query writing skills.
• Excellent communication and collaboration skills.

Responsibilities:

• Design, develop, and maintain robust streaming data pipelines using technologies like Apache Beam, Dataflow, or similar frameworks.
• Architect, implement, and optimize APIs that serve data from large-scale databases such as Google Bigtable.
• Design and optimize table schemas in Bigtable, following best practices for efficient data access and performance.
• Drive projects from concept to production, ensuring high-quality deliverables.
• Troubleshoot and resolve data pipeline issues, ensuring high availability of data services.
• Collaborate with cross-functional teams to architect scalable data solutions.