Staff Software Engineer - Build GPU AI for 10M Users

CHAI AI; Palo Alto (CA); On-site; USD 609,000 - 905,000; Full time

Benefits offered by this job

Health insurance

401k

Unlimited PTO

Job summary

CHAI AI is a social AI platform where millions of people create, share, and talk to AI characters. The engineering team is small (15–20 people) with a flat structure, enabling high impact and fast iteration.

You will fit a fleet of models into a fixed GPU budget to serve 10 million users with low latency and low error rate in production. Compensation is top-tier for a Bay Area AI startup, with $609,000 - $905,000 paid 100% in cash, benchmarked against Meta, Google, and OpenAI, plus health, 401k,

Qualifications

• 2+ years of software engineering experience.
• High motivation and talent.
• High ownership: comfortable with ambiguity, able to define the problem and plan.
• Able to work in person at Palo Alto Office.

Responsibilities

• Fit a fleet of models into a fixed GPU budget for production use.
• Serve 10 million users with low latency and low error rate.
• Collaborate with an engineering team to iterate quickly and measure impact.

Skills

Software engineering

Ownership

Ambiguity tolerance

In-person work

Job description

CHAI AI is a social AI platform where millions of people create, share, and talk to AI characters. The engineering team is small (15–20 people) with a flat structure, enabling high impact and fast iteration.

You will fit a fleet of models into a fixed GPU budget to serve 10 million users with low latency and low error rate in production. Compensation is top-tier for a Bay Area AI startup, with $609,000 - $905,000 paid 100% in cash, benchmarked against Meta, Google, and OpenAI, plus health, 401k,