Staff Software Engineer, AI Model Serving Platform

Perplexity; San Francisco (CA); On-site; USD 220,000 - 405,000; Full time

Job summary

Perplexity AI in San Francisco is seeking a deeply technical software engineer to own and evolve our model serving platform, connecting our products and research systems with our inference layers. This mission-critical system provides teams a fast, reliable interface across providers.

You will work at the intersection of distributed systems, AI products, and infrastructure, enabling teams to adopt new models, run rigorous experiments, and ship dependable products.

Qualifications

• 5+ years shipping large-scale systems.
• Strong backend craft with focus on DX.
• Proficiency in Python, Rust, C++, or Go.
• BS/MS/PhD in CS/Engineering (or equivalent).

Responsibilities

• Own and evolve the model serving platform.
• Design core abstractions for scalable systems.
• Lead high-conviction technical decisions.
• Write production Rust and Python for a service serving hundreds of millions of model requests daily.

Skills

Large-scale systems

Backend engineering

Python

Rust

C++

Go

AWS

Kubernetes

Education

CS/Engineering degree

Tools

Python

Rust

C++

Go

AWS

Kubernetes

Job description

Perplexity AI in San Francisco is seeking a deeply technical software engineer to own and evolve our model serving platform, connecting our products and research systems with our inference layers. This mission-critical system provides teams a fast, reliable interface across providers.

You will work at the intersection of distributed systems, AI products, and infrastructure, enabling teams to adopt new models, run rigorous experiments, and ship dependable products.