Senior Software Engineer - Data Lakehouse Infrastructure

TRM Labs; San Francisco (CA); Remote; USD 190,000 - 220,000; Part time

Job summary

Join a forward-thinking company as a Senior Software Engineer focused on building a modern data lakehouse infrastructure. You'll work with cutting-edge technologies like Apache Spark and GCP to design scalable data platforms that empower organizations to tackle complex global challenges. This role offers the chance to collaborate with experts across various fields, making a significant impact on security and analytics. If you're passionate about data engineering and thrive in a remote-first environment, this opportunity is perfect for you.

Benefits

Remote-first culture

Flexible working hours

Development opportunities

Collaborative environment

Qualifications

• 5+ years in data/software engineering focusing on distributed systems.
• Experience with building and scaling data platforms on GCP.

Responsibilities

• Architect and scale a high-performance data lakehouse on GCP.
• Design and optimize distributed query engines for analytical workloads.

Skills

Python

SQL

Apache Spark

GCP

Apache Airflow

Distributed Data Systems

Education

Bachelor's Degree in Computer Science or related field

Master's Degree (preferred)

Tools

Apache Trino

Snowflake

Apache Hudi

Iceberg

BigQuery

Job description

Senior Software Engineer - Data Lakehouse Infrastructure

Senior Software Engineer - Data Lakehouse Infrastructure

2 weeks ago Be among the first 25 applicants

Get AI-powered advice on this job and more exclusive features.

TRM Labs is a blockchain intelligence company committed to fighting crime and creating a safer world. By leveraging blockchain data, threat intelligence, and advanced analytics, our products empower governments, financial institutions, and crypto businesses to combat illicit activity and global security threats. At TRM, you'll join a mission-driven, fast-paced team made up of experts in law enforcement, data science, engineering, and financial intelligence, tackling complex global challenges daily. Whether analyzing blockchain data, developing cutting-edge tools, or collaborating with global organizations, you'll have the opportunity to make a meaningful and lasting impact.

We’re building the foundational data infrastructure powering next-generation analytics at scale. As part of our mission, we’re architecting a modern data lakehouse to support complex workloads, real-time data pipelines, and secure data governance—at petabyte scale.

We are looking for a Senior Data Engineer to help us design, implement, and scale core components of our lakehouse architecture. You will have ownership over data modeling, ingestion, query performance optimization, and metadata management using cutting-edge tools and frameworks like Apache Spark, Trino, Hudi, Iceberg, and Snowflake. We’re looking for engineers with deep expertise in at least one area and a solid understanding of the trade-offs among different technologies.

The impact you’ll have here:

• Architect and scale a high-performance data lakehouse on GCP, leveraging technologies like StarRocks, Apache Iceberg, GCS, BigQuery, Dataproc, and Kafka.
• Design, build, and optimize distributed query engines such as Trino, Spark, or Snowflake to support complex analytical workloads.
• Implement metadata management in open table formats like Iceberg and data discovery frameworks for governance and observability using Iceberg compatible catalogs.
• Develop and orchestrate robust ETL/ELT pipelines using Apache Airflow, Spark, and GCP-native tools (e.g., Dataflow, Composer).
• Collaborate across departments, partnering with data scientists, backend engineers, and product managers to design and implement
  
  

What we’re looking for:

• 5+ years of experience in data or software engineering, with a focus on distributed data systems and cloud-native architectures.
• Proven experience building and scaling data platforms on GCP, including storage, compute, orchestration, and monitoring.
• Strong command of one or more query engines such as Trino, Presto, Spark, or Snowflake.
• Experience with modern table formats like Apache Hudi, Iceberg, or Delta Lake.
• Exceptional programming skills in Python, as well as adeptness in SQL or SparkSQL.
• Hands-on experience orchestrating workflows with Airflow and building streaming/batch pipelines using GCP-native services.
  
  

About the Team:

• The Data Platform team is the funnel between all of TRM's data world and product world. We care about all layers of stack including petabyte of data stores, pipelines, and processes.
• We have quite a big scope as a the team with new and exciting projects every quarter. As a result, we collaborate across the board with most teams at TRM.
• We believe in async communication and are also not afraid to jump on a quick huddle if that helps to move things faster. We are both scrappy when the situation demands and also process-oriented when we need to achieve our OKRs.
• We are always looking for people who can elevate the quality our tech and our execution. If you enjoy a remote-first and async friendly environment to achieve efficacy and efficiency at petabyte scale, our team could be a great pick for you!
• Team members are based in the US across almost all timezones! Our on-call tends to be in EST/PST shift, whatever suits you the best.
• We do try to reserve some overlap in the day for meetings. Our north star - no IC spends more than 3-4 hours/week in meetings.
  
  

Learn about TRM Speed in this position:

• Build scalable engines to optimize routine scaling and maintenance tasks like create self-serve automation for creating new pgbouncer, scaling disks, scaling/updating of clusters, etc.
• Enable tasks to be faster next time and reducing dependency on a single person.
• Identify ways to compress timelines using 80/20 principle. For instance, what does it take to be operational in a new environment? Identify the must have and nice to haves that are need to deploy our stack to be fully operation. Focus on must haves first to get us operational and then use future milestones to harden for customer readiness. We think in terms of weeks and not months.
• Identify first version, a.k.a., "skateboards" for projects. For instance, build an observability dashboard within a week. Gather feedback from stakeholders after to identify more needs or bells and whistles to add to the dashboard.
  
  

About TRM's Engineering Levels:

Engineer: Responsible for helping to define project milestones and executing small decision decisions independently with the appropriate tradeoffs between simplicity, readability, and performance. Provides mentorship to junior engineers, and enhances operational excellence through tech debt reduction and knowledge sharing.

Senior Engineer: Successfully designs and documents system improvements and features for an OKR/project from the ground up. Consistently delivers efficient and reusable systems, optimizes team throughput with appropriate tradeoffs, mentors team members, and enhances cross-team collaboration through documentation and knowledge sharing.

Staff Engineer: Drives scoping and execution of one or more OKRs/projects that impact multiple teams. Partners with stakeholders to set the team vision and technical roadmaps for one or more products. Is a role model and mentor to the entire engineering organization. Ensures system health and quality with operational reviews, testing strategies, and monitoring rigor.

The following represents the expected range of compensation for this role:

• Individual pay is determined by skills, qualifications, experience, and location. The compensation details listed in this posting reflect the US base salary only.
• The estimated base salary range for this role is $190,000 - $220,000.
• Additionally, this role may be eligible to participate in TRM’s equity plan.
• Please note – we factor in the different costs for geographies outside the United States.
  
  

Life at TRM Labs

Leadership Principles

Our LPs are foundational elements of our strategy, guiding how we make decisions, how we treat each other, and how we behave day-to-day.

• Impact-Oriented Trailblazer – We put customers first, driving for speed, focus, and adaptability.
• Master Craftsperson – We prioritize speed, high standards, and distributed ownership.
• Inspiring Colleague – We value humility, candor, and a one-team mindset.
  
  

Accelerate your Career

Join a mission-driven team of industry leaders and make a real-world impact—disrupting terrorist networks, recovering stolen funds, and more. At TRM, you will:

• Work alongside top experts and learn every day.
• Embrace a growth mindset with development opportunities tailored to your role.
• Take on high-impact challenges in a fast-paced, collaborative environment.
  
  

Thrive as a Global Team

As a remote-first company, TRM Labs is built for global collaboration.

• We cultivate a strong remote culture through clear communication, thorough documentation, and meaningful relationships.
• We invest in offsites, regional meetups, virtual coffee chats, and onboarding buddies to foster collaboration.
• By prioritizing trust and belonging, we harness the strengths of a global team while staying aligned with our mission and values.
  
  

Join our mission!

We’re looking for team members who thrive in fast-paced, high-impact environments and love building from the ground up. TRM is remote-first, with an exceptionally talented global team. If you enjoy solving tough problems and seeing your work make a difference for billions of people, we want you here. Don’t worry if your experience doesn’t perfectly match a job description— we value passion, problem-solving, and unique career paths. If you’re excited about TRM’s mission, we want to hear from you.

Recruitment agencies

TRM Labs does not accept unsolicited agency resumes. Please do not forward resumes to TRM employees. TRM Labs is not responsible for any fees related to unsolicited resumes and will not pay fees to any third-party agency or company without a signed agreement.

Privacy Policy

By submitting your application, you are agreeing to allow TRM to process your personal information in accordance with the TRM Privacy Policy

Learn More: Company Values | Interviewing | FAQs

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Part-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Information Services

Referrals increase your chances of interviewing at TRM Labs by 2x

Sign in to set job alerts for “Senior Software Engineer” roles.

Director of Engineering - Remote USA (*eligible states)

Senior Software Engineer, Lead - Supply Chain

San Francisco, CA $223,000.00-$268,000.00 4 hours ago

Senior Software Engineer (Identity Decisioning)

Senior Software Engineer (Identity Decisioning)

Founding Team Senior Software Engineer Manager for a Social Travel Platform targeting Digital Nomads

San Francisco, CA $150,000.00-$200,000.00 2 months ago

Manager, Software Engineering (Pricing Engineering)

Software Engineering Leader - SLS, 3D Imaging, & Point Cloud

San Francisco, CA $150,000.00-$250,000.00 4 weeks ago

Manager, Software Engineering (Pricing Engineering)

San Francisco, CA $95,000.00-$230,000.00 2 months ago

Manager, Software Engineering (Merchant Risk Intelligence & Platform)

Manager, Software Engineering (Merchant Risk Intelligence & Platform)

Manager, Software Engineering (Cortex Xpanse ASM)

Senior Backend Software Engineer, Airbnb for Real Estate

Senior Software Engineer, Design Systems

San Francisco, CA $140,000.00-$180,000.00 3 months ago

San Francisco, CA $180,000.00-$240,000.00 5 months ago

San Francisco, CA $180,000.00-$240,000.00 5 months ago

Senior and Staff Backend Software Engineer - Evergreen

San Francisco, CA $147,000.00-$195,000.00 3 months ago

San Francisco, CA $185,200.00-$274,400.00 6 days ago

San Francisco, CA $160,000.00-$230,000.00 2 months ago

San Francisco, CA $150,000.00-$207,000.00 3 months ago

Senior Software Engineer, Connected Workflows

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.