Staff Engineer (Crusoe Managed Data Transfer, Distributed Systems)

Crusoe Energy Systems

Seattle (WA)

On-site

USD 180,000 - 260,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Crusoe Energy Systems seeks a Staff Engineer to serve as the technical lead and systems architect for the Managed Data Transfer (MDT) service. You will own MDT end-to-end design, including API, scheduler, Kubernetes transfer workers, and storage/network integration, with a focus on extensibility across clouds and regional pools.

You will mentor engineers, drive architecture reviews, and partner with product on scope and milestones, ensuring reliability and observability for customers relying on

Qualifications

  • 8+ years shipping production software, including leading a service from prototype to GA
  • Experience building or operating bulk data transfer systems at petabyte scale
  • Hands-on with Go or another modern compiled language (Go strongly preferred)
  • Experience defining API boundaries and schema contracts with partner teams, and negotiating them to agreement
  • Architectural ownership of MDT: API, scheduler, transfer workers on Kubernetes, storage integration

Responsibilities

  • Own end-to-end MDT design: API, scheduler, transfers, storage integration and network paths
  • Lead architecture reviews and mentor engineers on the team
  • Set throughput and correctness targets with benchmarks for line-rate transfers
  • Define cross-team interfaces with Storage, Network, Kubernetes, IAM, Billing and Monitoring
  • Plan extensibility for new clouds and regional worker pools, evaluating open-source and vendor options

Skills

Go
Distributed systems
Architectural design
Cross-team collaboration
Data transfer systems
Cloud networking
Operational ownership
Kubernetes

Tools

AWS DataSync
Google Storage Transfer Service
rclone
Kubernetes

Job description


  • We are looking for a Staff Engineer to be the technical lead and systems architect for Crusoe's Managed Data Transfer (MDT) service, the person who owns how its parts fit together and how MDT fits into Crusoe Cloud

  • MDT moves petabyte-scale training data between hyperscaler storage and Crusoe storage as a managed service, so AI labs and Physical AI companies can train on Crusoe GPUs without building their own transfer pipelines

  • You will design the control plane, the transfer worker fleet and the integration with Crusoe's storage and network, and set the path for adding other clouds and Crusoe-internal transfers

  • This is an engineering leadership role on a new team

  • Managed Data Transfer starts from a working prototype that already serves customers in production, so your first decisions are about what to keep, harden or replace, and how to sequence that work without disrupting the customers who depend on it

  • You will lead the design through Crusoe's architecture review, mentor the engineers who build it, and report to the Engineering Manager of Managed Data Transfer within Managed platform services

  • Architecture Ownership: Own the end-to-end design of MDT: the job API and scheduler, the transfer workers on Kubernetes, storage integration and network paths. You decide what the system looks like and explain why

  • Prototype Assessment and Migration: Evaluate the production prototype, decide what gets refactored, extended or replaced, and move its current users onto the managed service without interruption

  • Throughput and Correctness: Set the data-plane strategy (sharding, concurrency, straggler handling, checksum verification) and the benchmarks that prove it, aiming for line-rate transfers over dedicated interconnects

  • Cross-Team Contracts: Own the interfaces between MDT and Storage, Network, Kubernetes, IAM, Console, Billing and Monitoring. You define what partner teams build to and hold the line on it

  • Extensibility and Build-versus-Buy: Design for new clouds and Crusoe-internal transfers with a pluggable transfer engine and regional worker pools, and evaluate open-source and vendor options before the team builds

  • Operational Excellence: Set the bar for reliability, observability and on-call for every system the team ships

  • Product Partnership: Work with Product on scope, pricing trade-offs and milestones, and surface edge cases early enough to change the plan

  • Technical Mentorship: Raise the team's level through design reviews, RFC feedback and direct coaching, so the team runs well without depending on you


Benefits


  • Health & wellbeing: Comprehensive health benefits designed to support your overall wellness

  • Time away: Paid time off for vacations, family bonding, and unexpected needs

  • 401(k) match: Build your financial future with our 401(k) matching program

  • Mental wellness: Resources and support for your emotional wellbeing and navigating life’s challenges


We're looking for problem-solving, opportunity-finding teammates with a sense of urgency, who believe in the scale of our ambition and thrive on a path not fully paved - people who want to grow their careers alongside a team of experts across energy, manufacturing, data center construction, and cloud services If you want to do the most meaningful work of your career, help our customers and partners advance their AI strategies, and be part of a high-performing team that believes in each other, come build with us at Crusoe


Communication:

You can explain an architectural decision to an engineer, a PM and an EM, and you know which parts matter to each


Professional Experience:

8+ years shipping production software, including leading a service from prototype to general availability


Operational Ownership:

You have carried customer-facing on-call and built systems that are maintainable, observable and predictable


Software Engineering Craft:

Proficiency in Go or another modern compiled language (Go strongly preferred)


Data Movement and Storage Performance:

Understanding of object storage semantics, file systems and TCP throughput, and the ability to profile and fix a transfer that is slower than it should be


Cross-Team Influence:

Experience defining API boundaries and schema contracts with partner teams, and negotiating them to agreement


Systems Integration Judgment:

Proven ability to evolve a live system toward a better design while keeping risk to current customers low


Distributed Systems Depth:

Hands-on experience designing and operating data-intensive distributed systems at scale, including the failure modes that only appear in production


Experience building or operating bulk data transfer systems, such as AWS DataSync, Google Storage Transfer Service, or rclone at petabyte scale

Familiarity with cloud networking and interconnects, such as AWS Direct Connect or GCP Interconnect

Experience with cross-account cloud IAM and threat modeling for services that hold customer credentials

Approximate nearest-neighbor (ANN) indexing in depth:

HNSW, IVF, product and scalar quantization, DiskANN-style indexes that live on SSD


Experience with AI, HPC or Physical AI data pipelines
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer (Crusoe Managed Data Transfer)
Senior Software Engineer (Crusoe Managed Data Transfer)

Crusoe Energy Systems • Sunnyvale (CA)

On-site
USD 150,000 - 230,000
Health benefits
Paid time off
401(k) matching
+1
Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)
Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)

Crusoe • San Francisco (CA)

On-site
USD 215,000 - 260,000
Competitive compensation
Equity packages
Paid time off
+6
Senior Software Engineer, Crusoe Managed Data Transfer
Senior Software Engineer, Crusoe Managed Data Transfer

Crusoe • San Francisco (CA)

On-site
USD 170,000 - 205,000
Competitive compensation and equity
Restricted Stock Units
Paid time off, holidays & leave
+13
Sr. Staff Software Engineer, Managed Platform Services
Sr. Staff Software Engineer, Managed Platform Services

CRUSOE • Sunnyvale (CA)

On-site
USD 250,000 - 300,000
Competitive compensation
Equity
Paid time off
+8
Chief of Staff
Chief of Staff

Crusoe • San Francisco (CA)

On-site
USD 200,000 - 240,000
Equity
Health insurance
Paid time off
+2
Staff Software Engineer (Identity & Access Management)
Staff Software Engineer (Identity & Access Management)

Crusoe Energy Systems • San Francisco (CA)

On-site
USD 240,000 - 360,000
Health & wellbeing
Time away
401(k) match
+1
Senior Manager, Customer Support
Senior Manager, Customer Support

ProducePay • San Francisco (CA)

On-site
USD 144,000 - 165,000
Competitive compensation and equity packages
Comprehensive health, dental & vision insurance
401(k) Retirement plan with company match
+3
Senior Software Engineer, Storage
Senior Software Engineer, Storage

CRUSOE • San Francisco (CA)

On-site
USD 170,000 - 190,000
Competitive compensation
Restricted Stock Units
Health insurance
+3
Senior Software Engineer (DCIE)
Senior Software Engineer (DCIE)

Crusoe Energy Systems • San Francisco (CA)

On-site
USD 160,000 - 210,000
Health & wellbeing
Time away
401(k) match
+1
Senior Manager, Engineering Operations
Senior Manager, Engineering Operations

Crusoe • San Francisco (CA)

On-site
USD 230,000 - 280,000
Equity
Paid time off
Health insurance
+4