Senior Backend Engineer - Scale AI Services for 10M Users

Chai AI

Palo Alto (CA)

On-site

USD 477,000 - 652,000

Full time

2 days ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health
401k
Unlimited PTO

Job summary

CHAI AI in Palo Alto is seeking a software engineer to help build and scale services that sit between 10 million users and our vast model fleet. You will own routing, conversation state, and queuing with a focus on high throughput and low latency.

The role requires 2+ years of software engineering experience, strong ownership, and the ability to work in person at our Palo Alto office. You will join a flat, fast-moving team and be measured by clear product metrics.

Qualifications

  • 2+ years of software engineering experience.
  • High motivation and talented.
  • High ownership: comfortable with ambiguity, able to define the problem and the plan rather than execute a predefined spec.
  • Able to work in person at our Palo Alto Office.

Responsibilities

  • Build and scale services between 10M users and our model fleet – routing, conversation state, queuing.
  • Own end-to-end delivery with high volume, low latency, low error rate.

Skills

Software engineering
Ownership
Ambiguity management
In-person collaboration

Job description

CHAI AI in Palo Alto is seeking a software engineer to help build and scale services that sit between 10 million users and our vast model fleet. You will own routing, conversation state, and queuing with a focus on high throughput and low latency.

The role requires 2+ years of software engineering experience, strong ownership, and the ability to work in person at our Palo Alto office. You will join a flat, fast-moving team and be measured by clear product metrics.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Backend Engineer
Senior Backend Engineer

Chai AI • Palo Alto (CA)

On-site
USD 477,000 - 652,000
Health
401k
Unlimited PTO
AI Backend Engineer: Scale Enterprise AI Systems
AI Backend Engineer: Scale Enterprise AI Systems

Within • San Francisco (CA)

On-site
USD 140,000 - 190,000
Equity
Employer-Paid Medical
Parental Leave
+5
Staff Software Engineer
Staff Software Engineer

CHAI AI • Palo Alto (CA)

On-site
USD 609,000 - 905,000
Health insurance
401k
Unlimited PTO
Staff Software Engineer - Build GPU AI for 10M Users
Staff Software Engineer - Build GPU AI for 10M Users

CHAI AI • Palo Alto (CA)

On-site
USD 609,000 - 905,000
Health insurance
401k
Unlimited PTO
Staff Backend Engineer - Real-Time AI Platforms
Staff Backend Engineer - Real-Time AI Platforms

pika • United States

Hybrid
USD 180,000 - 260,000
Competitive salary
Equity
Health benefits
+1
Backend Engineer, AI-Driven Support Platform (SF)
Backend Engineer, AI-Driven Support Platform (SF)

Chime • San Francisco (CA)

On-site
USD 133,000 - 184,000
Four days in-office policy per week
Competitive salary & equity
Bonus benefits & 401k match
+1
Mid-Senior Backend Engineer - AI-Powered Real-Time Platform
Mid-Senior Backend Engineer - AI-Powered Real-Time Platform

Cypress HCM • San Francisco (CA)

On-site
USD 160,000 - 220,000
Staff Backend Engineer - Scale AI Agent Platform
Staff Backend Engineer - Scale AI Agent Platform

Broccoli AI • San Francisco (CA)

On-site
USD 190,000 - 230,000
Immediate Impact
Ownership aligned with impact
Work in-person with a high-trust team
Senior Backend Platform Engineer — Enterprise AI Systems
Senior Backend Platform Engineer — Enterprise AI Systems

Boson AI • Palo Alto (CA)

On-site
USD 150,000 - 400,000
Principal Backend Engineer - Scalable AI Infra
Principal Backend Engineer - Scalable AI Infra

Qualcomm • Santa Clara (CA)

On-site
USD 211,800 - 317,800