Senior or Staff Software Engineer, Data Platform

View full description

Requirements:

• A Bachelor's degree (or equivalent) in Computer Science or a related field.
• 8+ years of hands-on experience in architecting distributed system architecture.
• Exceptional programming skills in Python and adeptness in SQL or SparkSQL.
• In-depth experience with data stores such as Icerberg, Trino, BigQuery, and StarRocks.
• Proficiency in data pipeline and workflow orchestration tools like Airflow and DBT.
• Expertise in streaming workflows technologies including Spark, Kafka, and Flink.
• Competence in deploying and monitoring infrastructure in public cloud platforms.
• Proven ability in loading, querying, and transforming extensive datasets.

Responsibilities:

• Build highly reliable data services to integrate with dozens of blockchains.
• Develop complex ETL pipelines that process petabytes of structured and unstructured data in real-time.
• Design intricate data models for optimal storage and retrieval for sub-second latency querying.
• Oversee deployment and monitoring of large database clusters focusing on performance and high availability.
• Collaborate with data scientists, backend engineers, and product managers to create novel data models for TRM’s products.