Engineering Manager, Storage for AI Inference

Baseten; San Francisco (CA); On-site; USD 190,000 - 260,000; Full time

Benefits offered by this job

Competitive compensation and equity

Medical, dental, and vision insurance

Flexible PTO including Winter Break

Parental leave

Fertility and family-building stipend

401(k)

Learning and networking opportunities

Job summary

Baseten is seeking an Engineering Manager for Storage Products on the Runtime Fabric team. You will lead engineers building the Baseten Delivery Network and storage stack, including caching, snapshotters, and filesystems that support model deployment and training at scale.

You will own reliability, guide architectural evolution, and collaborate with containerd maintainers. Strong Go/Rust/C/C++ skills and Linux storage expertise are required, as is experience managing a technical team.

Qualifications

• Experience leading a systems/infrastructure/storage team
• Hands-on distributed storage, content-addressable storage, or large-scale caching
• Strong Go/Rust/C/C++ programming and code review skills
• Knowledge of Linux storage stack: filesystems, page cache, block devices
• Understanding of how container images are stored and delivered at scale
• Excellent written and verbal communication with cross-team influence

Responsibilities

• Hire and grow a team of 5 to 10 systems engineers with storage, caching, and Linux expertise
• Run planning and delivery: scope work against Runtime Fabric roadmap, set priorities, ship on cadence
• Provide coaching and career development for direct reports
• Own on-call health for the team’s services, including escalation paths
• Guide architecture and evolution of Baseten Delivery Network (BDN) and caching for cold starts
• Oversee on-host delivery: lazy-loading snapshotters, EROFS/overlayfs layouts, block-level delivery
• Own reliability with end-to-end instrumentation from initialization to first inference request
• Make delivery path work across heterogeneous clusters and cloud providers
• Review designs and code; contribute hands-on work when needed
• Champion contributions back to containerd and the snapshotter ecosystem

Skills

Go

Rust

C/C++

Team leadership

Distributed storage

Caching/infrastructure

Tools

Linux

containerd

Snapshotters

EROFs

FUSE

Job description

Baseten is seeking an Engineering Manager for Storage Products on the Runtime Fabric team. You will lead engineers building the Baseten Delivery Network and storage stack, including caching, snapshotters, and filesystems that support model deployment and training at scale.

You will own reliability, guide architectural evolution, and collaborate with containerd maintainers. Strong Go/Rust/C/C++ skills and Linux storage expertise are required, as is experience managing a technical team.