Senior Software Engineer, User-Space Networking

Baseten

New York (NY)

On-site

USD 160,000 - 330,000

Full time

44 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Medical, Dental, Vision insurance
Flexible PTO
Parental leave
Fertility stipend
401(k) plan
Learning & networking opportunities

Job summary

Baseten is seeking an Agent Infra Engineer to design and build the user-space, VPP-based data plane powering Baseten Sandboxes. You will connect microVM sandboxes across regions with multi-tenant overlays and expose the network as a programmable API for the platform.

You’ll collaborate with compute, storage, GPU infrastructure, and datacenter teams to cut latency, improve scale, and ensure secure ingress/egress with TLS and firewalling. Join a small team with end-to-end ownership.

Qualifications

  • Experience with user-space packet processing (DPDK, VPP, or similar) or virtualized network functions (VNF/NFV).
  • Experience building multi-tenant networking in production (VXLAN, GENEVE, VRF).
  • Experience building a software-defined network/overlay network or packet-processing data plane in production.

Responsibilities

  • Design and build the user-space, VPP-based data plane that connects microVM sandboxes to each other, to Baseten services, and to the internet.
  • Build multi-tenant virtual private networking and overlays across regions.
  • Expose the network as a programmable API that the rest of the platform calls.
  • Cut latency and raise connection scale for agent-to-agent and agent-to-service traffic.
  • Build routing that sends each request to the nearest region and keeps connections working as sandboxes suspend and resume.
  • Build secure ingress and egress for sandboxes, including firewalling, static egress IPs, and custom domains with managed TLS.
  • Build L7 proxies for request inspection, filtering, secret injection, and auditing.
  • Own per-sandbox addressing, including IPv6, and network isolation between tenants.
  • Build observability for the packet path across guest, host, and network, and debug production issues end to end.
  • Work closely with the compute, storage, GPU infrastructure, and datacenter teams

Skills

Rust
Go
C/C++
Systems programming
Networking
VPP/FD.io
Overlay networks
TCP/IP
Latency optimization
Debugging
Small teams

Tools

VPP/FD.io
EVPN
VXLAN
GENEVE
VRF
eBPF/XDP

Job description

Baseten is seeking an Agent Infra Engineer to design and build the user-space, VPP-based data plane powering Baseten Sandboxes. You will connect microVM sandboxes across regions with multi-tenant overlays and expose the network as a programmable API for the platform.

You’ll collaborate with compute, storage, GPU infrastructure, and datacenter teams to cut latency, improve scale, and ensure secure ingress/egress with TLS and firewalling. Join a small team with end-to-end ownership.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, User-Space Networking & Multi-Tenant Cloud
Software Engineer, User-Space Networking & Multi-Tenant Cloud

Baseten • San Francisco (CA)

On-site
USD 170,000 - 240,000
Competitive compensation
Meaningful equity
Medical, dental, and vision insurance
+5
Networking Engineer for AI Sandboxes & Private Cloud
Networking Engineer for AI Sandboxes & Private Cloud

Baseten • United States

Remote
USD 180,000 - 260,000
Senior Network Systems Engineer (Go/Rust/C++) - Remote
Senior Network Systems Engineer (Go/Rust/C++) - Remote

ContentBuffer • San Francisco (CA)

Remote
USD 140,000 - 180,000
Equity
Medical insurance
Flexible PTO
+2
Software Engineer, Networking (Agent Infra)
Software Engineer, Networking (Agent Infra)

Baseten • United States

Remote
USD 180,000 - 260,000
Networking Software Engineer for Multi-Tenant AI Sandboxes
Networking Software Engineer for Multi-Tenant AI Sandboxes

present of AI • San Francisco (CA)

On-site
USD 140,000 - 210,000
Networking Engineer — User-Space Data Plane
Networking Engineer — User-Space Data Plane

Candidate • San Francisco (CA)

On-site
USD 240,000 - 340,000
Competitive compensation
Meaningful equity
Flexible PTO
+3
Software Engineer, Networking (Agent Infra)
Software Engineer, Networking (Agent Infra)

LinuxCareers • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Full medical/dental/vision
Flexible PTO
+3
Software Engineer, Networking (Agent Infra)
Software Engineer, Networking (Agent Infra)

Candidate • San Francisco (CA)

On-site
USD 240,000 - 340,000
Competitive compensation
Meaningful equity
Flexible PTO
+3
Software Engineer, Networking (Agent Infra)
Software Engineer, Networking (Agent Infra)

Baseten • San Francisco (CA)

On-site
USD 170,000 - 240,000
Competitive compensation
Meaningful equity
Medical, dental, and vision insurance
+5
Low-Latency Multi-Tenant Networking Engineer
Low-Latency Multi-Tenant Networking Engineer

LinuxCareers • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Full medical/dental/vision
Flexible PTO
+3