Senior GPU Compute Infrastructure Engineer - On-site (SF/LA)

Vast.ai; Los Angeles (CA); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Comprehensive health, dental, vision

401(k) with company match

Meaningful equity

Onsite meals

Startup culture with rapid growth

Job summary

Vast.ai seeks a Senior Infrastructure Engineer to design and scale core systems powering its global GPU marketplace. You will extend compute infrastructure from provisioning and scheduling to billing, orchestration, and marketplace dynamics.

The role requires building large-scale, secure, multi-tenant platforms with Python and C++ on-site in SF or LA. You’ll work closely with founders and engineers to drive performance, reliability, and innovative pricing models in a fast-paced startup

Qualifications

• Experience building high-throughput backend systems or compute clouds.
• Familiarity with Docker or custom scheduling frameworks for compute orchestration.
• Understanding of GPU provisioning, driver management, and workload scheduling.
• Implemented or integrated usage-based billing and account credit systems.
• Knowledge of dynamic pricing, spot instances, or supply-demand balancing.
• Experience designing secure, multi-tenant cloud environments.

Responsibilities

• Improve the backend systems that power Vast.ai’s compute marketplace.
• Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs.
• Develop scalable infrastructure for workload scheduling and resource management.
• Optimize pricing and marketplace logic for efficiency and transparency.
• Benchmark, profile, and harden systems for performance, reliability, and fault tolerance.
• Collaborate with product and infrastructure teams to shape the future of decentralized compute.

Skills

Distributed Systems

Compute Orchestration

GPU Infrastructure

Billing & Metering

Marketplace Dynamics

Security & Multi-Tenancy

Programming: Python

Programming: C++

PostgreSQL Expertise

Tools

Python

C++

PostgreSQL

Linux

Docker

KVM

Redis

Terraform

AWS

REST/gRPC APIs

Job description

Vast.ai seeks a Senior Infrastructure Engineer to design and scale core systems powering its global GPU marketplace. You will extend compute infrastructure from provisioning and scheduling to billing, orchestration, and marketplace dynamics.

The role requires building large-scale, secure, multi-tenant platforms with Python and C++ on-site in SF or LA. You’ll work closely with founders and engineers to drive performance, reliability, and innovative pricing models in a fast-paced startup