Principal Software Engineer - Data Lakes

View full description

Requirements:

• 5+ years of hands-on or research experience with high-performance relational data management systems.
• Deep understanding of infrastructure & software optimizations and performance engineering to drive significant performance, latency, and availability improvements.
• Proven track record of leading and delivering large and complicated projects.
• Strong development skills in Java and C++.
• Solid experience with public clouds (AWS, Azure, GCP).
• Demonstrated knowledge of columnar storage formats.
• Growth mindset and excitement about breaking the status quo by seeking innovative solutions.
• Excellent team player who is consistent in making everyone around you better.
• Strongly prefer an MS or PhD in Computer Science, ideally focusing on database management and/or storage engines.

Responsibilities:

• Partner closely with product teams to understand requirements and design cutting-edge new capabilities that go directly into customer’s hands.
• Design, develop, implement, and operate highly reliable large-scale data lake systems in cooperation with a dedicated data lake engineering team.
• Contribute to open-source projects such as DuckDB.
• Embrace Fivetran innovations with open-source standards and toolsets.
• Analyze fault-tolerance and high availability issues, performance and scale challenges, and solve them.
• Ensure operational excellence of the services and meet the commitments to our customers regarding security, reliability, availability, and performance.
• Set technical directions and influence cross-functional teams.