ML Infrastructure Engineer

Alpaca Research; Cambridge (MA); On-site; USD 150,000 - 210,000; Full time

Job summary

Alpaca Research is based in Cambridge, MA, and is seeking an ML infra engineer to oversee the training infrastructure for NLP and Robotics research teams. You will set up and scale compute resources, enforce efficient utilization, and simplify access for researchers to accelerate experiments.

You will collaborate with researchers to tailor infrastructure to workflows, manage permissions, and engage with vendors to optimize costs and performance.

Qualifications

• Familiar with AWS, GCP, Azure, Slurm, Kubernetes.
• Proven track record of building & maintaining cloud-based infrastructure.
• Familiar with distributed infra & multi-host setups.
• Strong communications skills and independence in owning projects.
• Familiar with building testing pipelines, CI/CD, logging/telemetry for ML infra use

Responsibilities

• Setting up and scaling our compute resources.
• Enforcing efficient compute utilization.
• Communicating with compute vendors to secure competitive rates.
• Making compute resources easy for researchers to use.
• Managing permissions & onboarding/offboarding users

Skills

Cloud infra

CI/CD pipelines

Distributed systems

Communication skills

Independence in owning projects

Tools

AWS

GCP

Azure

Slurm

Kubernetes

Job description

Who we are

Today, AI is something you rent. Alpaca is building the full stack of hardware, software, models, and applications together to make it something you own.

We are developing a new computer architecture that breaks the economics keeping frontier models trapped in datacenters. On top of that, we’re building a platform of models, applications, and services that give that hardware meaning.

Personal AI is moving from the datacenter to the desk, and we are driving that change.

Our team is based in Cambridge, MA.

The Role:

We are looking for a ML infra engineer to oversee the training infrastructure for our NLP and Robotics research teams. In this role, you will be responsible for

• Setting up and scaling our compute resources
• Enforcing efficient compute utilization
• Communicating with compute vendors to get us the most competitive rates
• Making compute resources easy for researchers to use
• Managing permissions & onboarding/offboarding users

ML infrastructure is key to the success and productivity of our research teams. You will play in integral part in the day-to-day operations of our teams and help accelerate our research processes. In addition to maintaining our compute resources, you will also help set up resources so developers can easily access compute when needed. You will collaborate with researchers to set up infrastructure around their usage and develop tooling to match their workflows.

Minimum qualifications:

• Familiar with AWS, GCP, Azure, Slurm, Kubernetes
• Proven track record of building & maintaining cloud-based infrastructure
• Familiar with distributed infra & multi-host setups
• Strong communications skills and independence in owning projects
• Familiar with building testing pipelines, CI/CD, logging/telemetry for tracking ML infra use