Staff Software Engineer for AI Model Serving

United States Digital Space LLC; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

Perplexity in San Francisco is seeking a deeply technical software engineer to own and evolve our model serving platform, connecting products and research systems with inference layers. This mission-critical system provides a fast, reliable interface across providers.

You will operate at the intersection of distributed systems, AI products, and infrastructure, designing core abstractions, guiding technical decisions, and delivering production Rust and Python services handling hundreds of

Qualifications

• 5+ years of experience building and shipping large-scale systems with high reliability and performance.
• Proficiency in a general-purpose backend language (Python, Rust, C++, Go).
• BS, MS, or PhD in CS, Engineering, or related fields (or equivalent experience).

Responsibilities

• Own and evolve the model serving platform connecting products and research systems with inference layers.
• Design core abstractions, lead high-conviction technical decisions, and ship production Rust and Python services handling hundreds of millions of requests per day.

Skills

Distributed systems

Python

Rust

C++

Go

Software craftsmanship

Cloud infrastructure

Education

Bachelor's degree in Computer Science or Engineering

Tools

AWS

Kubernetes

Job description

Perplexity in San Francisco is seeking a deeply technical software engineer to own and evolve our model serving platform, connecting products and research systems with inference layers. This mission-critical system provides a fast, reliable interface across providers.

You will operate at the intersection of distributed systems, AI products, and infrastructure, designing core abstractions, guiding technical decisions, and delivering production Rust and Python services handling hundreds of