Senior Software Engineer, Data Platform
New
T
TRM LabsBlockchain Intelligence
Location: North America, US timezonesFull-TimeSenior
Salary not disclosed
Apply NowOpens the employer's application page
Job Details
- Experience
- 5+ years
- Required Skills
- DockerPythonSQLApache AirflowKafkaKubernetesSparkdbt
Requirements
- Bachelor's degree in Computer Science or a related field.
- 5+ years of hands-on experience in architecting distributed system architecture.
- Exceptional programming skills in Python.
- Adeptness in SQL or SparkSQL.
- Experience with data stores such as Iceberg, Trino, BigQuery, StarRocks, and Citus.
- Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT.
- Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
- Competence in deploying and monitoring infrastructure within public cloud platforms using Docker, Terraform, Kubernetes, and Datadog.
Responsibilities
- Build highly reliable data services to integrate with dozens of blockchains.
- Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
- Design and architect intricate data models for optimal storage and retrieval.
- Oversee the deployment and monitoring of large database clusters.
- Collaborate across departments to design and implement novel data models.
View Full Description & ApplyYou'll be redirected to the employer's site
