Data Engineer, Blockchain

View full description

Requirements:

• A self-motivated, team member with keen attention to detail.
• Proactive collaboration with team members and a willingness to adapt to a growing environment.
• Familiarity and experience with Rust, particularly focusing on data transformation and ingestion.
• A strong understanding of blockchain data structures and ingestion interfaces.
• Experience in real-time data handling, including knowledge of reorg handling.
• Familiarity with blockchain clients like Geth and Reth is a plus.
• Adaptability to a dynamic and fully-remote work environment.
• Rigorous approach to software development that reflects a commitment to excellence.

Responsibilities:

• Develop and maintain data ingestion adapters for various blockchain networks and web3 protocols.
• Implement data ingestion strategies for both historical and recent data.
• Apply strategies for handling block reorgs.
• Optimize the latency of block ingestion at the chain head.
• Write interfaces with file storage protocols such as IPFS and Arweave.
• Collaborate with upstream data sources, such as chain clients and tracing frameworks, and monitor the latest upstream developments.
• Perform data quality checks, cross-checking data across multiple sources and investigating any discrepancies that arise.