Senior Software Engineer (Crusoe Managed Data Transfer)

Crusoe Energy Systems

Sunnyvale (CA)

Sur place

USD 150 000 - 230 000

Plein temps

Il y a 4 jours
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Avantages offerts par ce poste

Health benefits
Paid time off
401(k) matching
Mental wellness resources

Résumé du poste

Crusoe Energy Systems seeks a Senior Software Engineer to build the MDT control plane, including the job API, scheduler and state management that coordinates resumable transfers. You will join early, shape the API for new clouds and Crusoe-internal transfers, and work closely with Storage, Network, IAM and Console teams.

You will design the data-transfer API, implement scheduling, and ensure end-to-end reliability with security and observability.

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or related field or equivalent experience.
  • 5+ years building cloud infrastructure or platform services.
  • Experience designing and shipping production backend services and APIs (Go, gRPC/REST).
  • Experience with distributed systems, retries, idempotency, and checkpointing.

Responsabilités

  • Design and build the MDT data-transfer API (create, list, get, cancel) with a provider-neutral model.
  • Develop the scheduler and state machine for splitting work across regional pools and tracking progress.
  • Implement secure cross-cloud identity and least-privilege access with IAM and audit logging.
  • Collaborate with Storage, Network, IAM, and Cloud Console teams and own on-call duties.

Connaissances

Backend engineering
Distributed systems
Go
Cross-team collaboration
On-call ownership

Formation

Bachelor's degree in CS/Engineering or related

Outils

Go programming
gRPC/REST
Kubernetes
Temporal/Argo
AWS IAM/ST最佳

Description du poste

  • Crusoe’s Managed Platform Services (MAPS) organization builds the managed services that make Crusoe Cloud easy to adopt and hard to leave, including Crusoe Container Registry, Cloud Monitoring and Managed Logs
  • Managed Data Transfer (MDT) is its newest service
  • MDT moves petabyte-scale training data from AWS S3, and later other clouds, into Crusoe storage with a single API call: the service shards the work across a fleet of transfer workers, verifies every object, and asks the customer to run nothing
  • For AI labs and Physical AI companies whose data lives with a hyperscaler, it removes one of the biggest obstacles to training on Crusoe GPUs
  • We are hiring Senior Software Engineers to build the MDT control plane: the job API, scheduler and job state that turn a customer request into a coordinated, resumable transfer
  • You will join a new team at the beginning, take the service from first commit to its preview launch with design-partner customers, and shape the API that new clouds and Crusoe-internal transfers will plug into later
  • You will work closely with the Storage, Network, IAM and Cloud Console teams, and report to the Engineering Manager of Managed Data Transfer
  • Job API and Lifecycle: Design and build the data-transfer API (create, list, get, cancel) with a provider-neutral model for sources and destinations, so new clouds and storage types can be added without breaking customers
  • Scheduling and Job State: Build the scheduler and state machine that split a bucket listing into units of work, place them on regional worker pools, and track progress, retries and resume across failures
  • Correctness at Scale: Make petabyte-scale jobs safe to retry and cancel, with end-to-end checksum verification and clear errors when a customer’s permissions or destination are wrong
  • Cross-Cloud Identity: Implement secure access to customer buckets with short-lived, least-privilege credentials (AWS role assumption first, other clouds next), integrated with Crusoe IAM and audit logging
  • Customer Surfaces: Ship the CLI and, with partner teams, the Terraform and Console experiences for creating and monitoring transfers
  • Operational Excellence: Instrument the service with metrics, logs and alerts, write the runbooks, and take part in the team’s on-call rotation
  • Cross-Team Collaboration: Agree the interfaces MDT depends on with Storage, Network, IAM and Console, and work with Product and Solutions Architects on early customer onboarding
Benefits
  • Health & wellbeing: Comprehensive health benefits designed to support your overall wellness
  • Time away: Paid time off for vacations, family bonding, and unexpected needs
  • 401(k) match: Build your financial future with our 401(k) matching program
  • Mental wellness: Resources and support for your emotional wellbeing and navigating life’s challenges

Educational Foundation: A bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent professional experience Backend Engineering Craft: Experience designing and shipping production backend services and APIs, ideally in Go, with gRPC or REST, relational databases and Kubernetes Collaboration and Writing: You work well across teams with different priorities, and your design docs settle decisions Security Mindset: Working knowledge of authentication, authorization and least privilege, and care in handling customer credentials API Design: Ability to design public APIs that customers automate against and that can grow without breaking changes Distributed Systems Judgment: Comfort with long-running, failure-prone work: idempotency, retries with backoff, leases, checkpointing and partial failure Professional Experience: 5+ years building cloud infrastructure or platform services, including taking a service from zero to general availability Operational Ownership: You have run services in production, been on call, and built the dashboards and alerts that keep incidents short Experience building on GPU or AI infrastructure Experience with job orchestration systems such as Temporal, Argo, or Kubernetes operators Experience with storage systems (object storage, NFS, parallel file systems) or high-throughput networking Hands-on experience with cross-cloud identity: AWS IAM and STS, GCP service-account impersonation, or Azure workload identity Experience with large-scale data movement, such as S3 multipart uploads, rclone, s5cmd, AWS DataSync or Google Storage Transfer Service

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Staff Engineer (Crusoe Managed Data Transfer, Distributed Systems)
Staff Engineer (Crusoe Managed Data Transfer, Distributed Systems)

Crusoe Energy Systems • Seattle (WA)

Sur place
USD 180 000 - 260 000
Senior Software Engineer, Crusoe Managed Data Transfer
Senior Software Engineer, Crusoe Managed Data Transfer

Crusoe • San Francisco (CA)

Sur place
USD 170 000 - 205 000
Competitive compensation and equity
Restricted Stock Units
Paid time off, holidays & leave
+13
Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)
Staff Engineer, Crusoe Managed Data Transfer (Distributed Systems)

Crusoe • San Francisco (CA)

Sur place
USD 215 000 - 260 000
Competitive compensation
Equity packages
Paid time off
+6
Senior Software Engineer, MDT Data Transfer Platform
Senior Software Engineer, MDT Data Transfer Platform

Crusoe Energy Systems • Sunnyvale (CA)

Sur place
USD 150 000 - 230 000
Health benefits
Paid time off
401(k) matching
+1
Senior Backend Engineer - AI Data Transfer Platform
Senior Backend Engineer - AI Data Transfer Platform

Crusoe • San Francisco (CA)

Sur place
USD 170 000 - 205 000
Competitive compensation and equity
Restricted Stock Units
Paid time off, holidays & leave
+13
Staff Software Engineer (CAPE)
Staff Software Engineer (CAPE)

Crusoe Energy Systems • Sunnyvale (CA)

Sur place
USD 230 000 - 300 000
Health benefits
Paid time off
401(k) match
+1
Senior Customer Support Engineer (Managed Inference)
Senior Customer Support Engineer (Managed Inference)

Crusoe Energy Systems • Denver (CO)

Sur place
USD 90 000 - 130 000
Health benefits
Paid time off
401(k) match
+1
Staff Software Engineer (Identity & Access Management)
Staff Software Engineer (Identity & Access Management)

Crusoe Energy Systems • San Francisco (CA)

Sur place
USD 240 000 - 360 000
Health & wellbeing
Time away
401(k) match
+1
Sr. Staff Software Engineer, Managed Platform Services
Sr. Staff Software Engineer, Managed Platform Services

CRUSOE • Sunnyvale (CA)

Sur place
USD 250 000 - 300 000
Competitive compensation
Equity
Paid time off
+8
Customer Support Engineer
Customer Support Engineer

Crusoe Energy Systems • New York (NY)

Sur place
USD 90 000 - 120 000
Health benefits
401(k) match
Paid time off
+1