Low-Latency Multi-Tenant Networking Engineer

LinuxCareers; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Equity

Full medical/dental/vision

Flexible PTO

Parental leave

Fertility stipend

401(k)

Job summary

Baseten is an AI inference platform designing and building a custom networking stack for Baseten Sandboxes where agents run in isolated microVMs and must communicate with each other, Baseten services, and external networks at scale. You will design user-space data planes and multi-tenant overlays to enable secure, high-performance networking across regions.

The role emphasizes Rust/Go/C/C++ systems programming, TCP/IP routing expertise, and experiences in overlay networks and latency

Qualifications

• Experience with user-space packet processing (DPDK, VPP, or similar) or virtualized network functions (VNF/NFV).
• Production experience building multi-tenant networking (VXLAN, GENEVE, VRF) and software-defined or overlay networks.
• Strong systems programming in Rust, Go, and/or C/C++ with production code ownership.
• Solid grounding in TCP/IP, routing, and experience building cloud networking infrastructure as a provider.
• Experience debugging latency and throughput issues with packet captures, tracing, and profiling.

Responsibilities

• Design and build user-space, VPP-based data planes that connect microVM sandboxes to each other, Baseten services, and the internet
• Build multi-tenant virtual private networking and overlays (EVPN, GENEVE, VXLAN) across regions with programmable APIs
• Optimize latency and connection scale for agent-to-agent and agent-to-service traffic, including routing for sandbox suspend/resume cycles
• Build secure ingress and egress infrastructure including firewalling, static egress IPs, custom domains with managed TLS, and L7 proxies for inspection and auditing
• Implement per-sandbox addressing, IPv6 support, network isolation, observability for the packet path, and debug production issues end-to-end

Skills

DPDK/VPP

VNF/NFV

Multi-tenant networking

Rust

Go

C/C++

TCP/IP routing

Cloud networking infrastructure

Tools

EVPN

VXLAN

GENEVE

VRF

Job description

Baseten is an AI inference platform designing and building a custom networking stack for Baseten Sandboxes where agents run in isolated microVMs and must communicate with each other, Baseten services, and external networks at scale. You will design user-space data planes and multi-tenant overlays to enable secure, high-performance networking across regions.

The role emphasizes Rust/Go/C/C++ systems programming, TCP/IP routing expertise, and experiences in overlay networks and latency