Software Engineer, Storage Systems (Agent Infra)

LinuxCareers; San Francisco (CA); On-site; USD 200,000 - 320,000; Full time

Benefits offered by this job

Equity

Comprehensive benefits

Winter Break

Parental leave

Fertility stipend

401(k)

Job summary

Baseten is an AI inference platform building Agent Drive, a distributed filesystem that enables agent sandboxes to mount over FUSE, focusing on storage architecture, performance, and multi-tenant isolation.

This role designes and implements core storage features, tackles tail latency, and drives correctness under concurrency while contributing to open-source storage projects and advancing performance across the stack.

Qualifications

• Strong systems programming background in Go, Rust, and/or C/C++, with comfort reading kernel code.
• Deep understanding of Linux filesystem and storage internals: VFS, page cache, dentry and inode caches, FUSE, block I/O, fsync semantics, and crash consistency.
• Hands-on experience building distributed storage systems, content-addressable storage, or large-scale caching infrastructure.
• Experience profiling I/O, memory, and RPC bottlenecks and optimizing tail latency in production.
• Ability to debug correctness bugs appearing under concurrency or partial failure conditions.

Responsibilities

• Design and implement core Agent Drive features including metadata replication, volume placement, garbage collection, and FUSE client behavior.
• Solve multi-attach correctness problems: cache coherency across many FUSE mounts, dentry and inode invalidation, write ordering, and crash consistency.
• Optimize tail latency on read and write paths including page cache strategy, writeback, prefetch, and metadata RPC batching.
• Build tenant isolation into the storage layer with quota enforcement, blast-radius containment, and noisy-neighbor mitigation.
• Own storage-side sandbox startup and resume performance, build observability into every layer, and contribute upstream to open-source storage projects.

Skills

Go

Rust

C/C++

Kernel development

FUSE

Distributed storage

Performance optimization

Concurrency debugging

Tools

eBPF

io_uring

perf

ftrace

blktrace

Job description

Baseten is an AI inference platform serving companies like Cursor and Notion. This role focuses on designing and building Agent Drive, a distributed filesystem that agent sandboxes mount over FUSE, with emphasis on storage architecture, performance, and multi-tenant isolation.

What You'll Do

• Design and implement core Agent Drive features including metadata replication, volume placement, garbage collection, and FUSE client behavior
• Solve multi-attach correctness problems: cache coherency across many FUSE mounts, dentry and inode invalidation, write ordering, and crash consistency
• Optimize tail latency on read and write paths including page cache strategy, writeback, prefetch, and metadata RPC batching
• Build tenant isolation into the storage layer with quota enforcement, blast-radius containment, and noisy-neighbor mitigation
• Own storage-side sandbox startup and resume performance, build observability into every layer, and contribute upstream to open-source storage projects

What You Need

• Strong systems programming background in Go, Rust, and/or C/C++, with comfort reading kernel code
• Deep understanding of Linux filesystem and storage internals: VFS, page cache, dentry and inode caches, FUSE, block I/O stack, fsync semantics, and crash consistency
• Hands-on experience building distributed storage systems, content-addressable storage, or large-scale caching infrastructure
• Experience profiling I/O, memory, and RPC bottlenecks and optimizing tail latency in production
• Ability to debug correctness bugs appearing under concurrency or partial failure conditions

Nice to Have

• Experience with a distributed filesystem or object store such as JuiceFS, CephFS, or S3-compatible storage, or contributions to those projects
• Knowledge of consensus and replication protocols such as Raft, leader leases, and quorum reads
• Experience with snapshot, clone, and copy-on-write filesystem features
• Experience operating multi-tenant storage with hard isolation requirements
• Familiarity with Linux performance tooling such as eBPF, io_uring, perf, ftrace, and blktrace

Competitive compensation including meaningful equity, 100% coverage of medical, dental, and vision insurance for employee and dependents (U.S. only), flexible PTO policy with company-wide Winter Break, paid parental leave, fertility and family-building stipend through Carrot, company-facilitated 401(k) (U.S. only)