Senior Data Engineer, Data Platform

Posted 3 months agoViewed
190000 - 220000 USD per year
USFull-TimeBlockchain Intelligence
Company:TRM Labs
Location:US, EST, PST
Languages:English
Seniority level:Senior, 5+ years
Experience:5+ years
Skills:
DockerPythonSQLBlockchainETLKafkaKubernetesAirflowData engineeringSparkTerraformData modeling
Requirements:
Bachelor's degree (or equivalent) in Computer Science or a related field. 5+ years of hands-on experience in architecting distributed system architecture. Exceptional programming skills in Python. Adeptness in SQL or SparkSQL. Experience with data stores such as Iceberg, Trino, BigQuery, StarRocks, and Citus. Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT. Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink. Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog. Proven ability in loading, querying, and transforming extensive datasets.
Responsibilities:
Build highly reliable data services to integrate with dozens of blockchains. Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time. Design and architect intricate data models for optimal storage and retrieval. Oversee the deployment and monitoring of large database clusters with a focus on performance and high availability. Collaborate across departments to design and implement novel data models.
About the Company
TRM Labs
101-250 employeesCryptocurrency
View Company Profile
Similar Jobs:
Posted 12 days ago
USFull-TimeSoftware and Data Platform
Senior Data Engineer, Data Platform
Company:AcuityMD
Posted 6 days ago
US, CanadaFull-TimeSenior Living Tech
Senior Data Platform Engineer
Posted 24 days ago
US, CanadaFull-TimeSenior Living Technology
Senior Data Platform Engineer
Company:Inspiren