Senior Infrastructure Engineer — On-site (SF/LA) + Equity

Vast.ai Inc.; San Francisco (CA); On-site; USD 180,000 - 230,000; Full time

Benefits offered by this job

Health benefits

401(k) with company match

Equity

Onsite meals

Collaborative startup culture

Job summary

Vast.ai seeks a Senior Infrastructure Engineer to design and scale the core systems powering its global GPU marketplace. You’ll work with the founders and engineering team to extend compute infrastructure—from provisioning and scheduling to billing, orchestration, and marketplace dynamics.

We value experience in large-scale distributed systems, GPU infrastructure, and dynamic pricing, with strong Python and C++ coding skills and a track record of building multi-tenant cloud platforms.

Qualifications

• Experience building high-throughput backend systems or compute clouds.
• Familiarity with Docker or custom scheduling frameworks.
• Understanding GPU provisioning, driver management, and workload scheduling.
• Implemented or integrated usage-based billing and account credit systems.
• Knowledge of dynamic pricing, spot instances, or supply-demand balancing mechanisms.
• Experience designing secure, multi-tenant cloud environments.
• Strong programming skills in Python and C++, with maintainable code.
• Designing schemas and queries for large-scale PostgreSQL databases.

Responsibilities

• Improve the backend systems that power Vast.ai’s compute marketplace.
• Integrate GPU provider onboarding, usage tracking, billing, and orchestration APIs.
• Develop scalable infrastructure for workload scheduling and resource management.
• Optimize pricing and marketplace logic for efficiency and transparency.
• Benchmark, profile, and harden systems for performance, reliability, and fault tolerance.
• Collaborate with product and infrastructure teams to shape the future of decentralized compute.

Skills

Distributed Systems

Compute Orchestration

GPU Infrastructure

Billing & Metering

Marketplace Dynamics

Security & Multi-Tenancy

Python

C++

PostgreSQL

Tools

Docker

KVM

Terraform

AWS

REST/gRPC

Job description

Vast.ai seeks a Senior Infrastructure Engineer to design and scale the core systems powering its global GPU marketplace. You’ll work with the founders and engineering team to extend compute infrastructure—from provisioning and scheduling to billing, orchestration, and marketplace dynamics.

We value experience in large-scale distributed systems, GPU infrastructure, and dynamic pricing, with strong Python and C++ coding skills and a track record of building multi-tenant cloud platforms.