Senior GPU Compute Infrastructure Engineer

Vast.ai; San Francisco (CA); On-site; USD 180,000 - 230,000; Full time

Benefits offered by this job

Health, dental, vision, life insurance

401(k) with company match

Equity

Onsite meals and snacks

Startup culture

Job summary

Vast.ai is seeking a Senior Infrastructure Engineer to design and scale core systems powering its global GPU marketplace. You will work with founders and a core engineering team to extend compute infrastructure—from GPU provisioning and scheduling to billing, orchestration, and marketplace dynamics.

We’re looking for someone who has previously built large-scale infrastructure platforms and distributed compute orchestration frameworks, with a strong focus on reliability and efficiency.

Qualifications

• Distributed systems: experience building high-throughput backend systems or compute clouds.

Responsibilities

• Improve the backend systems that power Vast.ai’s compute marketplace
• Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs
• Develop scalable infrastructure for workload scheduling and resource management
• Optimize pricing and marketplace logic for efficiency and transparency
• Benchmark, profile, and harden systems for performance, reliability, and fault tolerance
• Collaborate with product and infrastructure teams to shape the future of decentralized compute

Skills

Distributed Systems

Compute Orchestration

GPU Infrastructure

Billing & Metering

Marketplace Dynamics

Security & Multi-Tenancy

Python

C++

PostgreSQL

Linux

Docker

KVM

Terraform

AWS

REST/gRPC APIs

Tools

Docker

KVM

Terraform

AWS

Redis

PostgreSQL

Job description

Vast.ai is seeking a Senior Infrastructure Engineer to design and scale core systems powering its global GPU marketplace. You will work with founders and a core engineering team to extend compute infrastructure—from GPU provisioning and scheduling to billing, orchestration, and marketplace dynamics.

We’re looking for someone who has previously built large-scale infrastructure platforms and distributed compute orchestration frameworks, with a strong focus on reliability and efficiency.