Senior Data Platform Engineer — Petabyte-Scale, Remote

TRM Labs; United States; On-site; USD 190,000 - 220,000; Full time

Benefits offered by this job

Equity eligible

Job summary

TRM Labs is seeking a Senior Data Engineer for the Data Platform team to build scalable data services and ETL pipelines handling petabyte-scale blockchain activity. You will design data models for low-latency queries, deploy and monitor large clusters, and collaborate with data scientists, engineers, and product managers to advance TRM’s products.

The role emphasizes architecture, performance, and reliability within a distributed data infra, enabling safer financial systems at scale.

Qualifications

• A Bachelor's degree (or equivalent) in Computer Science or a related field.
• A proven track record, with 5+ years of hands-on experience in architecting distributed system architecture, guiding projects from initial ideation through to successful production deployment.
• Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
• In-depth experience with data stores such as Iceberg, Trino, BigQuery, and StarRocks, and Citus.
• Proficiency in data pipeline and workflow orchestration tools like Airflow, DBT, etc.
• Expertise in data processing technologies and streaming workflows including Spark, Kafka, and Flink.
• Competence in deploying and monitoring infrastructure within public cloud platforms, utilizing tools such as Docker, Terraform, Kubernetes, and Datadog.
• Proven ability in loading, querying, and transforming extensive datasets.

Responsibilities

• Build highly reliable data services to integrate with dozens of blockchains.
• Develop complex ETL pipelines that transform and process petabytes of structured and unstructured data in real-time.
• Design and architect intricate data models for optimal storage and retrieval to support sub-second latency for querying blockchain data.
• Oversee the deployment and monitoring of large database clusters with an unwavering focus on performance and high availability.
• Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement novel data models that enhance TRM’s products.

Skills

Distributed systems

Python

SQL

SparkSQL

Iceberg

Trino

BigQuery

StarRocks

Citus

Airflow

DBT

Spark

Kafka

Flink

Docker

Terraform

Kubernetes

Datadog

Education

Bachelor's degree in Computer Science

Tools

Docker

Terraform

Kubernetes

Datadog

Job description

TRM Labs is seeking a Senior Data Engineer for the Data Platform team to build scalable data services and ETL pipelines handling petabyte-scale blockchain activity. You will design data models for low-latency queries, deploy and monitor large clusters, and collaborate with data scientists, engineers, and product managers to advance TRM’s products.

The role emphasizes architecture, performance, and reliability within a distributed data infra, enabling safer financial systems at scale.