Staff Engineer, Data Federation and Online Archive

View full description

Requirements:

• 10+ years software engineering, primarily focused on backend systems
• Strong systems programming background; Go and Java experience a plus (but not required)
• Extensive experience designing and operating distributed systems at scale; Kubernetes experience is a plus (but not required)
• Experience with large-scale data processing or storage systems (e.g. data lake technologies, distributed databases, disaggregated storage, etc.)
• Knowledge of modern observability practices and tools
• Proven ability to lead technical initiatives as an individual contributor
• Experience mentoring senior engineers and driving technical excellence within a team

Responsibilities:

• Lead initiatives to improve system observability, stability, and resource management
• Design and implement advanced autoscaling solutions for query execution and data processing
• Reduce incident rates through holistic improvements to system resilience
• Identify opportunities to improve operating costs in storage and query systems
• Guide architectural decisions and conduct design reviews across two engineering teams
• Mentor senior engineers in distributed systems design and operational excellence
• Collaborate with Product Management on technical roadmap development
• Drive cross-team technical initiatives and standards
• Participate in on-call rotation and provide senior oversight for incident response and postmortem retrospectives
• Design and implement improvements to our distributed query execution engine
• Optimize data archival pipelines for increased throughput, durability and reliability
• Design and implement solutions for single-tenant isolation requirements