Technical Product Manager, Infrastructure

Vast.ai Inc.; Los Angeles (CA); Hybrid; USD 170,000 - 240,000; Full time

Benefits offered by this job

Health insurance

401(k) match

Equity

Onsite meals

Ambitious culture

AI agent budget

Job summary

Vast.ai Inc. in Los Angeles is seeking a Technical Product Manager to drive the backend of our GPU cloud marketplace. You’ll shape infrastructure, security, and reliability, turning complex non-functional requirements into shippable specs that improve uptime and cost-to-serve.

You’ll own scalability, observability, and tooling across thousands of decentrally hosted GPUs, working with a hands-on, AI-native team. The role combines engineering depth with product leadership in a fast-growth startup.

Qualifications

• 3+ years backend engineering experience.
• 3+ years in product management.
• Experience with security, scalability, reliability at scale, infrastructure tooling, distributed systems, observability, abuse/fraud prevention, compliance.

Responsibilities

• Own the infrastructure, security and reliability roadmap from concept to ship.
• Drive scalability and performance across the GPU cloud marketplace.
• Own metrics, tracing and tooling to monitor platform health and cost-to-serve.

Skills

Backend engineering

Product management

Security

Scalability

Observability

Job description

About Us

Vast.ai's cloud powers AI projects and businesses all over the world. We are democratizing and decentralizing AI computing—reshaping our future for the benefit of humanity.

We are a growing and highly motivated team dedicated to an ambitious technical plan. Our structure is flat, our ambitions are out-sized, and leadership is earned by shipping excellence.

About the Role

Vast.ai is seeking a Technical Product Manager to drive the backend our GPU cloud marketplace runs on. This is the software behind every live GPU rental (over 700k transactions a month): the daemon on every host's machines, the orchestration that powers each instance, and the infrastructure and test systems that let us ship it all at high velocity.

The Scale: With over 20k GPUs, our AI cloud platform powers thousands of bleeding-edge training runs and critical production workloads for 120k+ developers all over the planet. This is a product with real scale, real data, and real users from day one. The work you ship moves tangible revenue in weeks, not quarters.

The Challenge: We don't own the GPUs. Thousands of independent hosts price and operate them, and no two machines are alike. Your job is to make that heterogeneous, decentralized supply behave like the top-tier cloud our customers expect: fast, secure, and reliable.

What You'll Own

You'll drive the infrastructure, security, and reliability roadmap: sequencing competing priorities, turning non-functional requirements into specs engineering can build, and seeing them through until they ship. You'll own the metrics that prove it worked: platform uptime, fleet reliability, cost-to-serve. Initial focus areas:

• Scalability & performance. Keep the core systems fast and ahead of demand as the marketplace grows, from database performance to end-to-end latency.

• Security, trust & compliance. Harden the platform against attacks and abuse, and build the compliance roadmap enterprise customers need.

• Observability & infra tooling. Give every engineer a clear view of platform health, and every host a clear view of their fleet. Own the metrics, tracing, and tooling behind it.

Ideal Experience

• 3+ years as a backend engineer AND 3+ years in product management

• Hands-on experience with several of: security, scalability, reliability at scale, infrastructure tooling, distributed systems, observability, abuse/fraud prevention, compliance

• Industry experience in one or more of the following areas: software infrastructure, developer tooling (APIs, SDKs, CLIs), AI/ML, cloud computing, GPUs, or two-sided marketplaces

• Experience at a fast-paced startup or rapid-growth team

You Are

• AI-native. You work with AI agents every day, and you want to build the compute layer the AI era runs on.

• Deeply technical. You came up as an engineer, and you reason about scalability, security, and efficiency as product concerns, not afterthoughts.

• Persuasive across the stack. You can make a technical tradeoff legible to c-suite and a thankless migration compelling to the team doing it.

• Biased toward action. You'd rather ship the fix today than present the plan next week.

Tech Stack

Python, C++, SQL/PostgreSQL, Redis, Linux, Docker, AWS, Terraform, REST APIs, LLMs/AI agents

Interview Process

• Initial screening (virtual)

• Deep dive on the role and your experience (virtual)

• Live product and technical assessment (virtual)

• In person panel interview + product and technical assessment (on-site)

Annual Salary Range

$170,000–$240,000 base depending on experience, plus equity. We're profitable, venture-backed, and growing, so the equity is a stake in a real company with a real valuation, not a lottery ticket.

Benefits

• Comprehensive health, dental, vision, and life insurance

• 401(k) with company match

• Meaningful early-stage equity

• Onsite meals, snacks, and close collaboration with founders/tech leaders

• Ambitious, fast-paced startup culture where initiative is rewarded

• Ample AI agent budget

LOCATION: On-site at our office in Los Angeles (Westwood).