Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity AI

San Francisco (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Perplexity is seeking an experienced Platform Engineer to own a unified, self-serve compute platform for training and inference workloads. You will design and operate a GPU fleet across providers, build Kubernetes-based orchestration, and develop scheduling that balances long-running training with production inference at scale.

You will implement fault-tolerance, autoscaling, and observability, while shaping platform architecture in collaboration with inference and cloud infrastructure teams.

Qualifications

  • Strong Kubernetes expertise with CRDs and multi-cluster setups.
  • Experience managing GPU clusters at scale (NVIDIA, CUDA, high-speed networking).
  • Orchestrated compute across multiple clouds (AWS, GCP, CoreWeave).
  • Strong distributed systems basics: scheduling, resource allocation, fault tolerance.
  • Proficient in Go, Rust, or C++ for infra systems.
  • Experience supporting training and production inference workloads.
  • Self-starting; end-to-end ownership of platform problems.

Responsibilities

  • Build a self-serve compute platform. Design and own systems for training jobs and inference services without GPU provisioning.
  • Operate the GPU fleet with provisioning, lifecycle management, reliability, and cross-provider capacity integration.
  • Develop scheduling and placement to maximize capacity across providers while meeting constraints.
  • Support long-running distributed training and high-availability inference workloads on the same fleet.
  • Own Kubernetes-based GPU orchestration; write operators/CRDs and manage multi-cluster deployments.
  • Implement fault tolerance, autoscaling, and observability for resilient workloads.
  • Set technical direction with inference and cloud infra teams to shape architecture and roadmap.

Skills

Kubernetes
GPU clusters
Multi-cloud
Distributed systems
Go
Rust
C++
Training workloads
Inference workloads

Tools

Prometheus
Grafana
Weights & Biases

Job description

Perplexity serves hundreds of millions of queries a month, and every one of them fans out into multiple AI inference requests running in real time. Behind that sits a large GPU fleet spread across several cloud providers. Today, our inference engineers and researchers build models while also managing networking, securing capacity, and operating the underlying GPU clusters, responsibilities we want a dedicated platform team to own. Your job is to take ownership of that infrastructure and hide its complexity behind a unified, self-serve platform for running training and inference workloads.

RESPONSIBILITIES
  • Build a self-serve compute platform. Design and own the systems that let inference engineers and researchers launch training jobs and operate inference services without managing GPU provisioning, cluster configuration, or provider-specific infrastructure.
  • Operate the GPU fleet. Own provisioning, lifecycle management, reliability, and capacity integration across providers, giving teams a consistent way to use compute regardless of where it runs.
  • Solve for GPU scarcity. Build the scheduling and placement logic that finds available capacity across providers, packs it efficiently, and gets the right workload onto the right hardware under real constraints.
  • Support two very different workloads. Keep long-running distributed training jobs healthy while simultaneously guaranteeing the availability and latency of production inference services on the same fleet.
  • Own the Kubernetes for GPU orchestration. Write the operators and CRDs, and manage many clusters across providers so the platform behaves the same everywhere we run.
  • Make failure boring. Build the fault tolerance, autoscaling, and observability that keep the fleet utilized and let workloads survive node loss, provider hiccups, and capacity shifts without human intervention.
  • Set technical direction across teams. Partner with inference and cloud infrastructure engineers to turn operational constraints into a coherent platform architecture and roadmap.
QUALIFICATIONS

We expect you to have real depth in most of these:

  • Deep Kubernetes experience — custom operators, CRDs, and multi-cluster federation, not just running kubectl apply.
  • You’ve managed GPU clusters at scale: NVIDIA hardware, CUDA, and the networking that makes them fast (InfiniBand or RoCE).
  • You’ve orchestrated compute across multiple clouds (CoreWeave, AWS, GCP, or similar) and understand how different each one really is.
  • Strong distributed systems fundamentals: scheduling, resource allocation, and fault tolerance under load.
  • You write infrastructure and systems-level code in Go, Rust or C++.
  • You’ve supported both long-running training jobs and high-availability inference services, and you know why they pull infrastructure in opposite directions.
  • You own problems end-to-end and do well when the path forward isn’t laid out for you.
ADDITIONAL EXPERIENCE WE VALUE
  • Inference serving stacks: vLLM, SGLang, or TensorRT-LLM.
  • Slurm or other HPC schedulers.
  • GPU kernel work in CUDA or Triton — not required, but notable.
  • High-speed interconnects: InfiniBand, RoCE, or RDMA in production.
  • Observability for ML workloads: Prometheus, Grafana, or Weights & Biases.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • United States

Remote
USD 180,000 - 320,000
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)
Member of Technical Staff (Software Engineer, GPU Cluster Infrastructure)

Perplexity • United States

On-site
USD 180,000 - 240,000
Member of Technical Staff, GPU & Distributed Systems
Member of Technical Staff, GPU & Distributed Systems

Reactor • San Francisco (CA)

On-site
USD 160,000 - 230,000
Member of Technical Staff (AI Inference Engineer)
Member of Technical Staff (AI Inference Engineer)

FDE Times • San Francisco (CA)

On-site
USD 140,000 - 240,000
Member of Technical Staff (AI Inference Engineer)
Member of Technical Staff (AI Inference Engineer)

Perplexity • San Francisco (CA)

On-site
USD 140,000 - 210,000
Member of Technical Staff (AI Inference Engineer)
Member of Technical Staff (AI Inference Engineer)

Perplexity • New York (NY)

On-site
USD 220,000 - 485,000
Member of Technical Staff (AI Inference Engineer)
Member of Technical Staff (AI Inference Engineer)

Perplexity • Palo Alto (CA)

On-site
USD 220,000 - 485,000
Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Prime Intellect, Inc. • San Francisco (CA)

On-site
USD 150,000 - 300,000
Equity incentives
Platform Engineer
Platform Engineer

Waratah Recruitment Partners • United States

Remote
USD 150,000 - 230,000
Senior Staff Engineer - Infrastructure Systems
Senior Staff Engineer - Infrastructure Systems

Runware • United States

On-site
USD 250,000 - 320,000