Data Engineer (Lambda)
Company:P2P. org
Location:EU
Languages:English
Seniority level:Middle, 4+ years
Experience:4+ years
Skills:
PythonSQLBlockchainETLKafkaAirflowClickhouseData engineeringData modeling
Requirements:
4+ years in Data Engineering (ETL/ELT, data pipelines, streaming systems). Strong SQL skills with columnar databases (ClickHouse, Druid, BigQuery, etc.). Hands-on streaming frameworks experience (Flink, Kafka, or similar). Solid Python skills for data engineering and backend services. Proven track record of delivering pipelines and features to production on schedule. Strong focus on automation, reliability, maintainability, and documentation. Startup mindset: keep balance between speed and quality.
Responsibilities:
Design, maintain, and scale streaming ETL pipelines for blockchain data. Build and optimize ClickHouse data models and materialized views for high-performance analytics. Develop and maintain data exporters using orchestration tools. Implement data transformations and decoding logic. Establish and improve testing, monitoring, automation, and migration processes for pipelines. Ensure timely delivery of new data features in alignment with product goals. Combine multiple data sources — indexers and Kafka topics from third parties — to aggregate them into tables for our API. Create automation tools for data analyst inputs, such as a dictionary, to keep them up to date. Collaborate within the team to deliver accurate, reliable, and scalable data services that power the Lambda app.
