Senior or Staff Software Engineer, Data Platform

Posted about 2 months agoViewed

💎 Seniority level: Senior, 8+ years

📍 Location: US, EST,PST

💸 Salary: 200000 - 255000 USD per year

🔍 Industry: Financial services, Blockchain

🗣️ Languages: English

⏳ Experience: 8+ years

🪄 Skills: DockerPythonSQLBlockchainETLKafkaKubernetesAirflowData engineeringSparkCollaborationTerraformDocumentation

A Bachelor's degree (or equivalent) in Computer Science or a related field.
A proven track record with 8+ years of hands-on experience in architecting distributed system architecture.
Exceptional programming skills in Python and adeptness in SQL or SparkSQL.
In-depth experience with data stores such as Iceberg, Trino, BigQuery, and StarRocks.
Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT.
Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
Competence in deploying and monitoring infrastructure within public cloud platforms using Docker, Terraform, Kubernetes, and Datadog.
Proven ability in loading, querying, and transforming extensive datasets.

Build highly reliable data services to integrate with dozens of blockchains.
Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
Oversee the deployment and monitoring of large database clusters with a focus on performance and high availability.
Collaborate across departments to design and implement novel data models that enhance TRM’s products.

Posted about 2 months ago

📍 US

🔍 Blockchain intelligence and financial services

Bachelor's degree (or equivalent) in Computer Science or a related field.
5+ years of hands-on experience in architecting distributed system architecture.
Exceptional programming skills in Python.
Adeptness in SQL or SparkSQL.
In-depth experience with data stores such as ClickHouse, ElasticSearch, Postgres, Redis, and Neo4j.
Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, Luigi, Azkaban, and Storm.
Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools like Docker, Terraform, Kubernetes, and Datadog.

Build highly reliable data services to integrate with various blockchains.
Develop complex ETL pipelines for processing structured and unstructured data in real-time.
Design intricate data models to support optimal storage and retrieve with sub-second latency.
Oversee large database cluster deployment and monitoring with a focus on performance.
Collaborate with data scientists, engineers, and product managers to enhance TRM's products.

DockerPythonSQLBlockchainElasticSearchETLKafkaKubernetesAirflowClickhouseData engineeringPostgresRedisSparkCollaborationTerraformDocumentation

Posted about 2 months ago

Posted 5 months ago

📍 United States

💸 200000 - 255000 USD per year

🔍 Blockchain intelligence and financial services

A Bachelor's degree (or equivalent) in Computer Science or a related field.
8+ years of hands-on experience in architecting distributed systems.
Exceptional programming skills in Python and proficiency in SQL or SparkSQL.
In-depth experience with data stores such as Iceberg, Trino, BigQuery, and StarRocks.
Proficiency in tools like Airflow and DBT for data pipeline orchestration.
Expertise in technologies like Spark, Kafka, and Flink.
Competence in deploying and monitoring cloud infrastructure with tools like Docker and Terraform.
Proven ability in managing extensive datasets.

DockerPythonSQLBlockchainETLKafkaKubernetesAirflowData engineeringSparkCollaborationTerraform

Posted 5 months ago

🔧 Requirements