Senior Data Platform Engineer - Real-Time, Petabyte-Scale

TRM Labs; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Hidden Jobs is seeking a senior data platform engineer to design highly available data services for blockchain analytics. You will build ingestion services, real-time ETL pipelines, and storage models enabling sub-second queries on petabyte-scale datasets.

You will work closely with data scientists, product managers, and backend teams to deliver scalable, cost-efficient infrastructure across public clouds.

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent practical experience.
• 5+ years of experience architecting distributed systems from ideation through production.
• Strong Python programming ability plus working knowledge of SQL or SparkSQL.

Responsibilities

• Build reliable data ingestion services connecting to multiple blockchain networks.
• Design and operate real-time ETL pipelines at petabyte scale.
• Architect data models and storage layouts for sub-second latency.
• Deploy, monitor, and tune large distributed DB clusters with uptime and cost efficiency.
• Collaborate with data scientists, backend engineers, and product managers to design models.

Skills

Python

Distributed systems

SQL

SparkSQL

Education

Bachelor's degree in Computer Science

Tools

Iceberg

Trino

BigQuery

StarRocks

Citus

Airflow

DBT

Spark

Kafka

Flink

Docker

Terraform

Kubernetes

Datadog

Job description

Hidden Jobs is seeking a senior data platform engineer to design highly available data services for blockchain analytics. You will build ingestion services, real-time ETL pipelines, and storage models enabling sub-second queries on petabyte-scale datasets.

You will work closely with data scientists, product managers, and backend teams to deliver scalable, cost-efficient infrastructure across public clouds.