Senior/Staff AI Infrastructure Engineer

Socket.dev; San Francisco (CA); On-site; USD 120,000 - 190,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Team meals in office

Unlimited PTO

Job summary

Echelon is building an AI platform for Business Operations, working at high speed with founders and customers. The role focuses on secure execution substrates for agents, sandbox lifecycles, and scalable control-plane services in a multi-tenant environment.

You will own sandboxed code execution, observability, and durable job design, collaborating closely with teams to reduce latency and improve reliability. This is a hands-on infrastructure leadership position.

Qualifications

• 5+ years building production infrastructure or distributed systems.
• Hands-on ownership of multi-tenant workloads in production.
• Strong Linux knowledge across processes, filesystems, networking, and performance.

Responsibilities

• Design and operate sandbox lifecycle systems for agent code execution and browser work.
• Improve sandbox startup time, density, scheduling, and resource utilization.
• Build fast filesystem primitives for ephemeral and persistent agent state.
• Enforce tenant isolation, network policy, secrets boundaries, quotas, and least privilege access.
• Make long-running agent jobs durable via checkpointing and retries.
• Scale orchestration and control-plane services for bursty workloads.
• Build observability for resource pressure, failures, queue health, and latency.
• Run load tests, capacity plans, and incident reviews; fix root causes.

Skills

Production infra

Distributed systems

Developer platforms

Execution runtimes

Linux

Kubernetes

Infrastructure as Code

AWS

Azure

Go

Rust

TypeScript

Python

Tools

Firecracker

gVisor

Kata Containers

seccomp

eBPF

Job description

About Echelon

Echelon is building the AI platform for Business Operations. Our goal is to automate the knowledge work of BizOps so one exceptional operator can deliver the leverage of an entire team, as Ramp and Rippling have done for Finance and HR.
Our platform combines passive process mining with a living ontology that maps how work happens across people, systems, documents, decisions, and outcomes. It connects structured and unstructured data trapped in fragmented, duplicative, and legacy enterprise systems, then turns that context into automated workflows and AI agents.
We are an early-stage company tackling a difficult technical problem at high speed. Engineers work directly with founders and customers, make decisions with incomplete information, ship production systems, and own the results. The pace, rate of change, and standards are high.

The mandate
Build the secure execution substrate for Echelon's agents. You will scale ep * * ​
What you’ll own
Design and operate sandbox lifecycle systems for agent code execution, browser work, document processing, and tool use.
Improve sandbox startup time, density, scheduling, warm pools, caching, and resource utilization.
Build fast, reliable filesystem primitives for ephemerate and persistent agent state, large artifacts, and concurrent workloads.
Enforce tenant isolation, network policy, secrets boundaries, quotas, and least-privilege access.
Make long-running agent jobs durable through checkpointing, retries, idempotency, cancellation, and recovery.
Scale orchestration and control-plane services through rapid workload growth and unpredictable bursts.
Build observability for resource pressure, execution failures, queue health, noisy neighbors, cost, and end-to-end latency.
Run load tests, capacity plans, failure drills, and incident reviews; fix root causes rather than adding fragile workarounds.

What you bring
5+ years building production infrastructure, distributed systems, developer platforms, or execution runtimes.
Hands-on ownership of containerized or virtualized workloads in a multi-tenant production environment.
Strong Linux systems knowledge across processes, filesystems, networking, resource isolation, and performance debugging.
Experience with Kubernetes or a comparable scheduler, infrastructure as code, and cloud primitives on AWS or Azure.
Strong programming ability in Go, Rust, TypeScript, Python, or another systems-oriented language.
Experience designing for retries, idempotency, backpressure, load shedding, observability, and safe rollouts.
Security instincts appropriate for executing untrusted or model-generated work.

Useful experience
Firecracker, gVisor, Kata Containers, namespaces/cgroups, seccomp, or eBPF.
Sandbox products such as E2B, Modal, Fly Machines, or custom epigenetic compute platforms.
FUSE, overlay filesystems, content-addressed storage, snapshotting, distributed caches, or object storage.
Agent runtimes, code interpreters, browser automation, remote development environments, or CI execution systems.
BYOC, private networking, customer-managed deployments, or enterprise security reviews.
Inngest, Temporal, Kafka, NATS, or other durable workflow and event systems.

Benefits

• Fully covered health, dental, and vision insurance.
• 401(k) plan.
• Team lunches and dinners in the office.
• Unlimited PTO.