Senior or Staff Software Engineer, Data Platform (Brazil)

TRM Labs; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Hidden Jobs is seeking a senior data platform engineer to design highly available data services for blockchain analytics. You will build ingestion services, real-time ETL pipelines, and storage models enabling sub-second queries on petabyte-scale datasets.

You will work closely with data scientists, product managers, and backend teams to deliver scalable, cost-efficient infrastructure across public clouds.

Qualifications

• Bachelor's degree in Computer Science or related field or equivalent practical experience.
• 5+ years of experience architecting distributed systems from ideation through production.
• Strong Python programming ability plus working knowledge of SQL or SparkSQL.

Responsibilities

• Build reliable data ingestion services connecting to multiple blockchain networks.
• Design and operate real-time ETL pipelines at petabyte scale.
• Architect data models and storage layouts for sub-second latency.
• Deploy, monitor, and tune large distributed DB clusters with uptime and cost efficiency.
• Collaborate with data scientists, backend engineers, and product managers to design models.

Skills

Python

Distributed systems

SQL

SparkSQL

Education

Bachelor's degree in Computer Science

Tools

Iceberg

Trino

BigQuery

StarRocks

Citus

Airflow

DBT

Spark

Kafka

Flink

Docker

Terraform

Kubernetes

Datadog

Job description

Role overview

A senior-level engineering role within a data platform team building petabyte-scale infrastructure that powers blockchain analytics products. The position centers on designing highly available data services, real-time ETL pipelines, and storage models that support sub-second query latency on massive datasets. Engineers collaborate closely with data scientists, product managers, and backend teams that serve public- and private-sector clients depending on the platform for investigative and security workflows.

Responsibilities

• Build reliable data ingestion services that connect to many different blockchain networks.
• Design and operate real-time ETL pipelines that transform structured and unstructured data at petabyte scale.
• Architect data models and storage layouts that optimize query performance and support sub-second latency.
• Deploy, monitor, and tune large distributed database clusters with a focus on uptime and cost efficiency.
• Partner with data scientists, backend engineers, and product managers to design models that unlock new product capabilities.

Requirements

• Bachelor's degree in Computer Science or a related field, or equivalent practical experience.
• Five or more years of experience architecting distributed systems from ideation through production.
• Strong programming ability in Python plus working knowledge of SQL or SparkSQL.
• Hands-on experience with one or more data stores such as Iceberg, Trino, BigQuery, StarRocks, or Citus.
• Familiarity with orchestration tools like Airflow or DBT and streaming frameworks such as Spark, Kafka, or Flink.
• Production experience deploying infrastructure on a public cloud with Docker, Terraform, Kubernetes, and Datadog.