Software Engineer, Compute Infrastructure for AI Platforms

Alpaca Research

Cambridge (MA)

On-site

USD 150,000 - 210,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Alpaca Research in Cambridge, MA is seeking a Software Engineer for Compute Infrastructure to own and maintain core backend systems that researchers rely on. You will ensure speed, reliability, and security as the company grows.

You will work across Kubernetes, cloud VMs, and on‑prem machines, improve performance with measurements, and help build robust, scalable tooling for AI research. Ideal candidates have strong systems engineering, experience with Rust or willingness to become fluent, and a

Qualifications

  • Strong systems engineering fundamentals and experience shipping production services in Rust, or the ability to become fluent quickly.
  • Experience building or operating schedulers, distributed control planes or job orchestration systems.
  • Hands-on cloud infrastructure experience on AWS or GCP: compute, GKE/EKS, IAM and quotas.
  • A habit of measuring: profiling, load testing, and stating claims with numbers.
  • Care for correctness: state machines, idempotency, failure handling, and tests that try to break your own code.
  • Hands-on fluency with AI coding agents, and good judgment about when to trust their output.
  • Clear writing for design docs, runbooks and decisions.

Responsibilities

  • Own production systems. Operate and maintain distributed backend services end to end. Debug hard production problems and be a first responder when things break.
  • Improve performance. Profile, load-test and optimise services and databases under heavy concurrent load, and back every change with measurements.
  • Build for reliability. Design for failure: retries, idempotency, recovery and consistency under partial outages. Test it with fault injection and simulation.
  • Work across compute environments. Kubernetes, cloud VMs and on‑prem machines, across various hardware configurations.
  • Keep it secure. Own access control, least‑privilege permissions and cost guardrails.
  • Support internal users. Work closely with researchers and engineers to understand their needs and improve their experience with the tools you maintain.

Skills

Rust production experience
Schedulers / job orchestration
Cloud infra AWS/GCP
Profiling / load testing
State machines / idempotency
AI coding agents fluency
Technical writing

Tools

Kubernetes

Job description

Alpaca Research in Cambridge, MA is seeking a Software Engineer for Compute Infrastructure to own and maintain core backend systems that researchers rely on. You will ensure speed, reliability, and security as the company grows.

You will work across Kubernetes, cloud VMs, and on‑prem machines, improve performance with measurements, and help build robust, scalable tooling for AI research. Ideal candidates have strong systems engineering, experience with Rust or willingness to become fluent, and a

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Software Engineer, Compute Infrastructure
Software Engineer, Compute Infrastructure

Alpaca Research • Cambridge (MA)

On-site
USD 150,000 - 210,000
ML Infra Engineer — Scale AI Training Compute
ML Infra Engineer — Scale AI Training Compute

Alpaca Research • Cambridge (MA)

On-site
USD 120,000 - 180,000
ML Infrastructure Engineer
ML Infrastructure Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 120,000 - 180,000
Senior Quality Engineer: AI-Driven Testing & Platform CI/CD
Senior Quality Engineer: AI-Driven Testing & Platform CI/CD

Alpaca • San Mateo (CA)

On-site
USD 180,000 - 240,000
Stock options
Health benefits
Home-office setup (USD 500)
+1
Product Security & Connectivity Engineer
Product Security & Connectivity Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 140,000 - 170,000
Equity
Platform Security Engineer - Linux & Rust
Platform Security Engineer - Linux & Rust

Cybersecurity Jobs • Cambridge (MA)

On-site
USD 140,000 - 170,000
Dental insurance
Health insurance
Paid time off
+1
Senior Data Platform Engineer — Remote
Senior Data Platform Engineer — Remote

Alpaca • United States

Remote
USD 180,000 - 240,000
Stock options
Health benefits
One-time USD 500 home-office setup
+1
Senior Platform QA Engineer - AI-Driven Testing & CI/CD
Senior Platform QA Engineer - AI-Driven Testing & CI/CD

Alpaca • United States

Remote
USD 180,000 - 240,000
Competitive Salary & Stock Options
Health Benefits
New Hire Home-Office Setup: USD 500
+1
Senior Software Engineer – Low-Latency Go Systems
Senior Software Engineer – Low-Latency Go Systems

Alpaca • United States

Remote
USD 160,000 - 230,000
Competitive salary
Stock options
Home-office setup $500
+1
Senior Data Platform Engineer - Remote & Stock Options
Senior Data Platform Engineer - Remote & Stock Options

Alpaca • United States

Remote
USD 150,000 - 190,000
Health Benefits
New Hire Home-Office Setup: One-time $
Monthly Stipend: $150 per month