Software Engineer, Compute Infrastructure

Alpaca Research

Cambridge (MA)

On-site

USD 150,000 - 210,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Alpaca Research in Cambridge, MA is seeking a Software Engineer for Compute Infrastructure to own and maintain core backend systems that researchers rely on. You will ensure speed, reliability, and security as the company grows.

You will work across Kubernetes, cloud VMs, and on‑prem machines, improve performance with measurements, and help build robust, scalable tooling for AI research. Ideal candidates have strong systems engineering, experience with Rust or willingness to become fluent, and a

Qualifications

  • Strong systems engineering fundamentals and experience shipping production services in Rust, or the ability to become fluent quickly.
  • Experience building or operating schedulers, distributed control planes or job orchestration systems.
  • Hands-on cloud infrastructure experience on AWS or GCP: compute, GKE/EKS, IAM and quotas.
  • A habit of measuring: profiling, load testing, and stating claims with numbers.
  • Care for correctness: state machines, idempotency, failure handling, and tests that try to break your own code.
  • Hands-on fluency with AI coding agents, and good judgment about when to trust their output.
  • Clear writing for design docs, runbooks and decisions.

Responsibilities

  • Own production systems. Operate and maintain distributed backend services end to end. Debug hard production problems and be a first responder when things break.
  • Improve performance. Profile, load-test and optimise services and databases under heavy concurrent load, and back every change with measurements.
  • Build for reliability. Design for failure: retries, idempotency, recovery and consistency under partial outages. Test it with fault injection and simulation.
  • Work across compute environments. Kubernetes, cloud VMs and on‑prem machines, across various hardware configurations.
  • Keep it secure. Own access control, least‑privilege permissions and cost guardrails.
  • Support internal users. Work closely with researchers and engineers to understand their needs and improve their experience with the tools you maintain.

Skills

Rust production experience
Schedulers / job orchestration
Cloud infra AWS/GCP
Profiling / load testing
State machines / idempotency
AI coding agents fluency
Technical writing

Tools

Kubernetes

Job description

Who we are

Today, AI is something you rent. Alpaca is building the full stack of hardware, software, models, and applications together to make it something you own.

We are developing a new computer architecture that breaks the economics keeping frontier models trapped in datacenters. On top of that, we’re building a platform of models, applications, and services that give that hardware meaning.

Personal AI is moving from the datacenter to the desk, and we are driving that change.

Our team is based in Cambridge, MA.

Software Engineer, Compute Infrastructure

You will own and maintain core infrastructure that our research depends on, keeping it fast, reliable and secure as the company grows.

In This Role You Will
  • Own production systems. Operate and maintain distributed backend services end to end. Debug hard production problems and be a first responder when things break.

  • Improve performance. Profile, load-test and optimise services and databases under heavy concurrent load, and back every change with measurements.

  • Build for reliability. Design for failure: retries, idempotency, recovery and consistency under partial outages. Test it with fault injection and simulation.

  • Work across compute environments. Kubernetes, cloud VMs and on‑prem machines, across various hardware configurations.

  • Keep it secure. Own access control, least‑privilege permissions and cost guardrails.

  • Support internal users. Work closely with researchers and engineers to understand their needs and improve their experience with the tools you maintain.

What We Hope You’ll Bring
  • Strong systems engineering fundamentals and experience shipping production services in Rust, or the ability to become fluent quickly.

  • Experience building or operating schedulers, distributed control planes or job orchestration systems.

  • Hands‑on cloud infrastructure experience on AWS or GCP: compute, GKE/EKS, IAM and quotas.

  • A habit of measuring: profiling, load testing, and stating claims with numbers.

  • Care for correctness: state machines, idempotency, failure handling, and tests that try to break your own code.

  • Hands‑on fluency with AI coding agents, and good judgment about when to trust their output.

  • Clear writing for design docs, runbooks and decisions.

Bonus Points
  • Running GPU fleets at scale: drivers, NCCL, high-speed interconnects, spot capacity.

  • Experience with Kueue, JobSet or other batch scheduling on Kubernetes.

  • Experience building infrastructure for ML research teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, Compute Infrastructure for AI Platforms
Software Engineer, Compute Infrastructure for AI Platforms

Alpaca Research • Cambridge (MA)

On-site
USD 150,000 - 210,000
ML Infrastructure Engineer
ML Infrastructure Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 120,000 - 180,000
Software Engineer, AI Automation — Compute Operations
Software Engineer, AI Automation — Compute Operations

Simplify • San Francisco (CA)

On-site
USD 224,000 - 300,000
Equity
Competitive compensation
Software Engineer, Compute Infrastructure
Software Engineer, Compute Infrastructure

OpenAI • Los Angeles (CA)

On-site
USD 230,000 - 405,000
Equity
Flexible work environment
Health benefits
Member of Technical Staff — Compute Cluster
Member of Technical Staff — Compute Cluster

Kindredventures • San Francisco (CA)

On-site
USD 140,000 - 230,000
Hardware Systems Engineer - AI Hardware
Hardware Systems Engineer - AI Hardware

Cloudflare, Inc. • United States

Hybrid
USD 180,000 - 260,000
Member of Technical Staff
Member of Technical Staff

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 280,000
Member of Technical Staff, AI Compute & Data Infrastructure
Member of Technical Staff, AI Compute & Data Infrastructure

Vinci • Palo Alto (CA)

On-site
USD 180,000 - 240,000
Product ML Engineer
Product ML Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 140,000 - 200,000
Software Engineer, Compute Infrastructure
Software Engineer, Compute Infrastructure

OpenAI, Inc. • San Francisco (CA)

On-site
GBP 120,000 - 190,000