Edge & Node

Posted 2024-11-15

💸 100000 - 500000 USD per year

🔍 Web3 / blockchain

Experience in database system internals.
Rust familiarity is highly desirable.
Knowledge of Apache DataFusion and its ecosystem is highly desirable.
General knowledge of distributed data systems and resource management is highly desirable.
Background with data ingestion from blockchain or other high-throughput sources is a plus.
Adaptability to a dynamic and fully-remote work environment.
Rigorous approach to software development that reflects a commitment to excellence.

Leveraging and contributing to Apache DataFusion while monitoring upstream developments.
Implementing storage strategies for blockchain and web3 data sources.
Developing a streaming processing system to update outputs incrementally.
Applying resource isolation in a multi-tenant environment.
Building data transformation pipelines for blockchain data.
Optimizing compaction and garbage collection processes.
Developing supportive tooling, including tracing and profiling.

Posted 2024-11-15

Posted 2024-11-15

📍 North America, South America, Europe

💸 100000 - 500000 USD per year

🔍 Web3, blockchain

A self-motivated, team member with keen attention to detail.
Proactive collaboration with team members and a willingness to adapt to a growing environment.
Familiarity and experience with Rust, particularly focusing on data transformation and ingestion.
A strong understanding of blockchain data structures and ingestion interfaces.
Experience in real-time data handling, including knowledge of reorg handling.
Familiarity with blockchain clients like Geth and Reth is a plus.
Adaptability to a dynamic and fully-remote work environment.
Rigorous approach to software development that reflects a commitment to excellence.

Develop and maintain data ingestion adapters for various blockchain networks and web3 protocols.
Implement data ingestion strategies for both historical and recent data.
Apply strategies for handling block reorgs.
Optimize the latency of block ingestion at the chain head.
Write interfaces with file storage protocols such as IPFS and Arweave.
Collaborate with upstream data sources, such as chain clients and tracing frameworks, and monitor the latest upstream developments.
Perform data quality checks, cross-checking data across multiple sources and investigating any discrepancies that arise.

Software DevelopmentBlockchainData StructuresRustCollaborationAttention to detail

Posted 2024-11-15

Posted 2024-11-15

📍 North America, South America, Europe

💸 100000 - 500000 USD per year

🔍 Web3

Strong proficiency in Rust, particularly with WASM integration and Wasmtime.
Great understanding of memory and execution isolation in WASM.
Experience with Rust and JavaScript for tooling and developer experience is a bonus.
Adaptability to a dynamic and fully-remote work environment.
Rigorous approach to software development that reflects a commitment to excellence.

Developing and integrating WebAssembly (WASM) runtime environments to support user-defined functions and custom data transformations.
Applying WASM execution in Rust using Wasmtime to enhance performance.
Implementing multi-tenant WASM environments with an understanding of sandboxing and deterministic execution, and support for parallel invocation of a module.
Building developer tooling for WASM modules written in Rust and JS/TS, including interface definition, unit testing, debugging, and efficient build tooling.

Software DevelopmentJavascriptJavaScriptRust

Posted 2024-11-15

🔧 Requirements