ApplyStaff Software Engineer, Data Incrementalization
Posted 8 months agoViewed
View full description
💎 Seniority level: Staff, 5+ years
📍 Location: United States, EST,PST
💸 Salary: 240000 - 270000 USD per year
🔍 Industry: Blockchain intelligence and financial services
🏢 Company: TRM Labs👥 101-250💰 $70,000,000 Series B over 2 years agoCryptocurrencyComplianceBlockchainBig Data
🗣️ Languages: English
⏳ Experience: 5+ years
🪄 Skills: DockerPythonSQLETLKafkaKubernetesSnowflakeAirflowAlgorithmsData engineeringData StructuresPostgresSparkCollaborationTerraform
Requirements:
- Bachelor's degree (or equivalent) in Computer Science or related field.
- 5+ years of experience in building distributed system architecture, focusing on incremental updates.
- Strong programming skills in Python and SQL.
- Deep technical expertise in advanced data structures and algorithms for incremental updating.
- Knowledge of data stores like BigQuery, Snowflake, RedShift, and more.
- Experience orchestrating data pipelines using Airflow, DBT, Luigi, etc.
- Proficiency in data processing technologies like Spark, Kafka, Flink.
- Ability to deploy and monitor systems in public cloud environments.
Responsibilities:
- Design and build our Cloud Data Warehouse focusing on incremental updates for cost efficiency.
- Research methods to optimize data processing, storage, and retrieval.
- Develop and maintain ETL pipelines for structured and unstructured data.
- Collaborate with teams on new data models and tools for innovation.
- Continuously monitor and optimize performance for cost, scalability, and reliability.
Apply