Staff Engineer, Distributed AI Systems & Scheduling

Gimlet Labs

San Francisco (CA)

On-site

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

A technology company in San Francisco is seeking a Member of Technical Staff to design and build distributed systems for AI workloads. The role involves developing scheduling and resource management components, as well as building production-grade APIs. Ideal candidates should have strong software engineering skills and experience with distributed systems. This role is perfect for engineers who enjoy foundational infrastructure work and can operate systems at scale.

Qualifications

  • Strong software engineering fundamentals are essential.
  • Experience in building or operating distributed systems in production is a must.
  • Ability to reason about concurrency and failure modes in large-scale systems.

Responsibilities

  • Design and build distributed systems for AI workloads.
  • Develop scheduling and resource management components.
  • Build production-grade APIs for workload management.
  • Implement reliability and fault tolerance mechanisms.
  • Ensure system observability at scale.
  • Collaborate with compilers and hardware for system performance.

Skills

Strong software engineering fundamentals
Experience with distributed systems
Concurrency and failure modes understanding

Tools

Kubernetes
RPC or asynchronous messaging systems
Languages: Go, C++, Python

Job description

A technology company in San Francisco is seeking a Member of Technical Staff to design and build distributed systems for AI workloads. The role involves developing scheduling and resource management components, as well as building production-grade APIs. Ideal candidates should have strong software engineering skills and experience with distributed systems. This role is perfect for engineers who enjoy foundational infrastructure work and can operate systems at scale.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Engineer, Distributed Systems for AI Platforms
Staff Engineer, Distributed Systems for AI Platforms

Gimlet Labs, Inc. • San Francisco (CA)

On-site
USD 150,000 - 350,000
Staff Distributed Systems Engineer — AI Infra, Open Source
Staff Distributed Systems Engineer — AI Infra, Open Source

TrustIn • San Francisco (CA)

On-site
USD 450,000 - 550,000
Competitive compensation
Meaningful equity
High-impact work
Staff Engineer, AI-Driven Customer Engagement Platform
Staff Engineer, AI-Driven Customer Engagement Platform

Databricks Inc. • San Francisco (CA)

On-site
USD 190,000 - 260,000
Comprehensive benefits
Inclusive culture
Opportunities for advancement
Senior AI Infrastructure Engineer
Senior AI Infrastructure Engineer

Menlo Ventures • San Francisco (CA)

Hybrid
USD 315,000 - 560,000
Competitive compensation
Generous vacation and parental leave
Flexible working hours
Staff Engineer - AI-Driven Backend & Architecture
Staff Engineer - AI-Driven Backend & Architecture

daydream • San Francisco (CA)

On-site
USD 200,000 - 280,000
Health coverage including medical, dental, and vision
Monthly commuter reimbursement
Lunch reimbursement on office days
+4
Senior AI Infra Engineer — Scale Systems, Equity & PTO
Senior AI Infra Engineer — Scale Systems, Equity & PTO

King River Capital Group • San Francisco (CA)

On-site
USD 100,000 - 130,000
Great health insurance, dental, and vision
Gym and workspace stipends
Unlimited PTO
Senior AI Platform Engineer: Scale, Reliability & Leadership
Senior AI Platform Engineer: Scale, Reliability & Leadership

AlphaSense, Inc. • San Francisco (CA)

On-site
USD 178,000 - 267,000
Equity options
Generous benefits program
Staff Engineer, Scalable AI Inference Infrastructure
Staff Engineer, Scalable AI Inference Infrastructure

Inferact • San Francisco (CA)

Hybrid
USD 200,000 - 400,000
Generous health, dental, and vision benefits
401(k) company match
Equity options
Staff AI Engineer - Full-Stack Production Features
Staff AI Engineer - Full-Stack Production Features

The Engineering Company • San Francisco (CA)

On-site
USD 150,000 - 200,000
Competitive salary
Health, dental, and vision coverage
Flexible time off
+1
Staff ML Systems Engineer — Distributed Training at Scale
Staff ML Systems Engineer — Distributed Training at Scale

RadixArk • Palo Alto (CA)

On-site
USD 120,000 - 160,000
Comprehensive benefits
Flexible work arrangements