Staff Engineer, AI Inference & Distributed Systems

Sail Research

San Francisco (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Free meals
Studio Display at desk
Friendly office environment with a cat

Job summary

Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while focusing on deep observability of our systems.

The ideal candidate has a strong background in distributed systems and is eager to engage in complex challenges. Enjoy a vibrant work environment with excellent meals and a collaborative team atmosphere.

Qualifications

  • Strong distributed systems fundamentals in concurrency and networking.
  • Eager to work with agents, focusing on correctness and edge cases.
  • Bonus: experience with ML inference stacks and GPUs.

Responsibilities

  • Design and implement high-performance schedulers.
  • Build global routing and traffic management.
  • Create deep observability systems for failure tracing.

Skills

Distributed systems fundamentals
Concurrency
Networking
Databases
Performance engineering
Experience with ML inference stacks

Job description

Sail Research in San Francisco is seeking a talented engineer to design and implement robust systems that ensure fast and cost-efficient AI inference at global scale. You will be responsible for building high-performance schedulers and optimizing global routing while focusing on deep observability of our systems.

The ideal candidate has a strong background in distributed systems and is eager to engage in complex challenges. Enjoy a vibrant work environment with excellent meals and a collaborative team atmosphere.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer, AI Inference & Distributed Systems
Staff Engineer, AI Inference & Distributed Systems

Sail Research Inc. • San Francisco (CA), Northern (KY)

Hybrid
USD 150,000 - 190,000
Free meals
Studio Display at desk
Coffee variety in office
+1
Staff Engineer — AI Inference & Distributed Systems
Staff Engineer — AI Inference & Distributed Systems

Sail • San Francisco (CA)

On-site
USD 150,000 - 190,000
Member of Technical Staff - Distributed Systems
Member of Technical Staff - Distributed Systems

Sail • San Francisco (CA)

On-site
USD 150,000 - 190,000
Member of Technical Staff - Distributed Systems
Member of Technical Staff - Distributed Systems

Sail Research • San Francisco (CA)

On-site
USD 120,000 - 160,000
Free meals
Studio Display at desk
Friendly office environment with a cat
Staff Engineer — Sailboxes & High-Performance AI Infra
Staff Engineer — Sailboxes & High-Performance AI Infra

Sail Research • San Francisco (CA)

On-site
USD 180,000 - 240,000
Meals provided
Studio Display
Coffee options
+1
Staff Engineer, AI Billing & Infra
Staff Engineer, AI Billing & Infra

Theory Ventures • San Francisco (CA)

On-site
USD 150,000 - 210,000
Staff AI Inference Kernel Engineer
Staff AI Inference Kernel Engineer

Sail • San Francisco (CA)

On-site
USD 180,000 - 240,000
Staff Engineer, Scalable AI Inference Infrastructure
Staff Engineer, Scalable AI Inference Infrastructure

Inferact • San Francisco (CA)

Hybrid
USD 200,000 - 400,000
Generous health, dental, and vision benefits
401(k) company match
Equity options
Inference Systems Engineer: Scalable AI Infrastructure
Inference Systems Engineer: Scalable AI Infrastructure

Candidate • San Francisco (CA)

On-site
USD 180,000 - 240,000
Flexible PTO
Medical, dental, vision benefits
Life insurance and disability benefits
+4
Senior AI Agent Engineer - Open Models & Evaluation Systems
Senior AI Agent Engineer - Open Models & Evaluation Systems

Sail Research • San Francisco (CA)

On-site
Confidential