Member of Technical Staff - Distributed Systems

Gimlet Labs, Inc.; San Francisco (CA); On-site; USD 150,000 - 350,000; Full time

Job summary

Gimlet Labs, Inc. is seeking a Member of Technical Staff to focus on distributed systems in San Francisco, California. This role involves designing and building the core platform for AI workloads, developing resource management components, and creating production-grade APIs. The ideal candidate should have strong software engineering fundamentals and experience with distributed systems. The compensation range is between $150K and $350K, commensurate with experience.

Qualifications

• Experience with building or operating distributed systems in production environments.
• Comfort with concurrency, failure modes, and tradeoffs in large‑scale systems.

Responsibilities

• Design and build distributed systems that orchestrate AI workloads.
• Develop scheduling and resource management components.
• Build production-grade APIs for managing workloads.

Skills

Strong software engineering fundamentals

Experience building or operating distributed systems

Reasoning about concurrency and tradeoffs

Tools

Kubernetes

Go

C++

Python

Job description

Mission

Gimlet Labs is seeking a Member of Technical Staff focused on distributed systems. In this role, you will build the core platform that schedules, routes, and operates AI workloads reliably at production scale. You will work on systems that coordinate execution across thousands of nodes, expose stable production APIs, and ensure workloads run predictably under real-world load and failure conditions. This role is well‑suited for engineers who enjoy building foundational infrastructure, understanding systems end‑to‑end, and operating at scale.

Responsibilities

• Design and build distributed systems that orchestrate and operate AI workloads at large scale
• Develop scheduling, routing, and resource management components that coordinate execution across many nodes and services
• Build production-grade APIs and control planes for deploying and managing workloads
• Implement mechanisms for reliability, availability, and fault tolerance in distributed environments
• Instrument systems for observability and debugging at scale
• Work closely with compilers, runtimes, and hardware to ensure end‑to‑end system correctness and performance

Qualifications

• Strong software engineering fundamentals
• Experience building or operating distributed systems in production environments
• Comfort reasoning about concurrency, failure modes, and tradeoffs in large‑scale systems

Preferred Qualifications

• Experience with Kubernetes or Kubernetes‑adjacent systems beyond basic usage
• Experience designing service‑oriented architectures using RPC or asynchronous messaging
• Familiarity with scheduling, queues, or resource management systems
• Experience building reliable APIs and operating systems under high load
• Software development experience in languages commonly used for systems development (e.g., Go, C++, Python)

Compensation Range: $150K - $350K