Engineering Manager, AI Inference Storage

US Health Partners, LLC; San Francisco (CA); Presencial; USD 180 000 - 260 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Competitive compensation with equity

US medical/dental/vision coverage for

Flexible PTO including Winter Break

Paid parental leave

Fertility and family-building stipend

Company 401(k)

ML startup exposure and learning

Resumo da oferta

Baseten is seeking an Engineering Manager for Storage Products within the Runtime Fabric team to lead the storage stack supporting AI inference. You will own reliability, drive architecture, and manage a small team of systems engineers while collaborating with containerd maintainers and platform teams.

You will shape caching, delivery pathways, and storage interfaces powering fast cold-starts and scalable model deployment across cloud environments.

Qualificações

• Experience managing a team of engineers in systems, infrastructure, or storage.
• Hands-on background in distributed storage systems or large-scale caching infrastructure.
• Strong systems programming and code-review capabilities in Go, Rust, or C/C++.

Responsabilidades

• Hire and grow a team of 5–10 systems engineers with storage, caching, and Linux expertise.
• Plan and deliver against the Runtime Fabric roadmap and set priorities.
• Provide coaching, feedback, and career development for direct reports.
• Own on-call health for the team’s services and incidents.
• Guide architecture and evolution of the Baseten Delivery Network (BDN) and storage products.
• Define interfaces for model deployment, training, and customers to reach storage paths.
• Oversee on-host delivery: lazy-loading snapshotters, EROFS/overlayfs layouts.
• Ensure end-to-end reliability with instrumentation and safe rollout of changes.
• Collaborate with containerd maintainers and cross-functional partners.

Conhecimentos

Team leadership

Go

Rust

C/C++

Distributed storage

Linux internals

Code reviews

Communication

Formação académica

Bachelor’s degree in CS/Engineering

Ferramentas

containerd

snapshotters

Kubernetes

Descrição da oferta de emprego

Baseten is seeking an Engineering Manager for Storage Products within the Runtime Fabric team to lead the storage stack supporting AI inference. You will own reliability, drive architecture, and manage a small team of systems engineers while collaborating with containerd maintainers and platform teams.

You will shape caching, delivery pathways, and storage interfaces powering fast cold-starts and scalable model deployment across cloud environments.