Software Engineer, User-Space Networking & Multi-Tenant Cloud

Baseten; San Francisco (CA); On-site; USD 170,000 - 240,000; Full time

Benefits offered by this job

Competitive compensation

Meaningful equity

Medical, dental, and vision insurance

Flexible PTO with Winter Break

Paid parental leave

Fertility and family-building stipend

401(k)

Exposure to ML startups

Job summary

Baseten is building a next-generation agent infrastructure in San Francisco. The Agent Infra team designs and ships a user-space, VPP-based data plane that connects microVM sandboxes with Baseten services and the internet, aiming for low latency and high throughput.

You will own multi-tenant networking, overlays, and programmable APIs that power the platform, collaborating across compute, storage, GPU, and datacenter teams to ship features fast.

Qualifications

• Experience with user-space packet processing (DPDK, VPP, or similar) or virtualized network functions (VNF/NFV).
• Experience building multi-tenant networking in production (VXLAN, GENEVE, VRF).
• Experience building a software-defined network, overlay network, or packet-processing data plane in production.
• You write production code: strong systems programming in Rust, Go, and/or C/C++. Network architects are welcome if they build, not only configure.
• Experience building cloud networking as the provider, not only consuming a cloud provider's network.
• Solid grounding in TCP/IP and routing.
• Experience building or operating proxies, load balancers, or L4/L7 gateways at scale.
• Experience debugging latency and throughput problems with packet captures, tracing, and profiling.
• You move fast and like owning a problem end to end on a small team.

Responsibilities

• Design and build the user-space, VPP-based data plane that connects sandboxes to each other, Baseten services, and the internet.
• Build multi-tenant networking and overlays across regions (EVPN, GENEVE, VXLAN).
• Expose the network as a programmable API that the rest of the platform calls.
• Cut latency and raise connection scale for agent-to-agent and agent-to-service traffic.
• Build routing that sends each request to the nearest region and maintains connections during suspend/resume.
• Build secure ingress and egress for sandboxes, including firewalling, static egress IPs, and TLS domains.
• Build L7 proxies for inspection, filtering, secret injection, and auditing.
• Own per-sandbox addressing, including IPv6, and isolation between tenants.
• Build observability for the packet path across guest, host, and network, and debug production issues end to end.
• Work closely with the compute, storage, GPU infrastructure, and datacenter teams.

Skills

User-space networking

DPDK/VPP/NFV

Multi-tenant networking

Rust/Go/C/C++

Network security

TCP/IP fundamentals

Latency debugging

Low-latency networking

Tools

VPP

FD.io

Job description

Baseten is building a next-generation agent infrastructure in San Francisco. The Agent Infra team designs and ships a user-space, VPP-based data plane that connects microVM sandboxes with Baseten services and the internet, aiming for low latency and high throughput.

You will own multi-tenant networking, overlays, and programmable APIs that power the platform, collaborating across compute, storage, GPU, and datacenter teams to ship features fast.