ML Infrastructure Engineer

Alpaca Research

Cambridge (MA)

On-site

USD 120,000 - 180,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Alpaca in Cambridge, MA is hiring an ML infra engineer to oversee the training infrastructure for our NLP and Robotics research teams. You will set up and scale compute resources, enforce efficient utilization, and work with compute vendors to secure competitive rates.

You will make compute resources easy for researchers to use, manage access, and collaborate with researchers to tailor infrastructure to their workflows while maintaining CI/CD, logging, and telemetry.

Qualifications

  • Strong communications skills and independence in owning projects.
  • Familiar with building testing pipelines, CI/CD, logging/telemetry for tracking ML infra use.

Responsibilities

  • Setting up and scaling our compute resources.
  • Enforcing efficient compute utilization.
  • Communicating with compute vendors to get us the most competitive rates.
  • Making compute resources easy for researchers to use.
  • Managing permissions & onboarding/offboarding users.
  • Collaborate with researchers to set up infrastructure around usage and develop tooling to match workflows.

Skills

Strong communication
Independence
Project ownership

Tools

AWS
GCP
Azure
Slurm
Kubernetes

Job description

Who we are

Today, AI is something you rent. Alpaca is building the full stack of hardware, software, models, and applications together to make it something you own.

We’re developing a new computer architecture that breaks the economics keeping frontier models trapped in datacenters. On top of that, we’re building a platform of models, applications, and services that give that hardware meaning.

Personal AI is moving from the datacenter to the desk, and we are driving that change.

Our team is based in Cambridge, MA.

The Role:

We are looking for a ML infra engineer to oversee the training infrastructure for our NLP and Robotics research teams. In this role, you will be responsible for

  • Setting up and scaling our compute resources
  • Enforcing efficient compute utilization
  • Communicating with compute vendors to get us the most competitive rates
  • Making compute resources easy for researchers to use
  • Managing permissions & onboarding/offboarding users

ML infrastructure is key to the success and productivity of our research teams. You will play in integral part in the day-to-day operations of our teams and help accelerate our research processes. In addition to maintaining our compute resources, you will also help set up resources so developers can easily access compute when needed. You will collaborate with researchers to set up infrastructure around their usage and develop tooling to match their workflows.

Minimum qualifications:
  • Familiar with AWS, GCP, Azure, Slurm, Kubernetes
  • Proven track record of building & maintaining cloud-based infrastructure
  • Familiar with distributed infra & multi-host setups
  • Strong communications skills and independence in owning projects
  • Familiar with building testing pipelines, CI/CD, logging/telemetry for tracking ML infra use
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infra Engineer — Scale AI Training Compute
ML Infra Engineer — Scale AI Training Compute

Alpaca Research • Cambridge (MA)

On-site
USD 120,000 - 180,000
Software Engineer, Compute Infrastructure
Software Engineer, Compute Infrastructure

Alpaca Research • Cambridge (MA)

On-site
USD 150,000 - 210,000
Member of Technical Staff
Member of Technical Staff

Harrison Clarke • San Francisco (CA)

On-site
USD 180,000 - 280,000
AI Infrastructure Engineer
AI Infrastructure Engineer

Pokee AI • United States

Remote
USD 140,000 - 220,000
Software Engineer – ML Infrastructure
Software Engineer – ML Infrastructure

People Culture Talent • San Francisco (CA)

On-site
USD 190,000 - 230,000
Machine Learning Infrastructure Engineer
Machine Learning Infrastructure Engineer

Alexander Chapman • New York (NY)

On-site
USD 140,000 - 200,000
Competitive salary
Equity
Health, dental, and vision insurance
Member of Technical Staff - ML Engineer
Member of Technical Staff - ML Engineer

Acceler8 Talent • Cambridge (MA)

Hybrid
USD 140,000 - 210,000
Member of Technical Staff - ML Infra
Member of Technical Staff - ML Infra

Kindredventures • San Francisco (CA)

On-site
USD 160,000 - 220,000
Product ML Engineer
Product ML Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 140,000 - 200,000
ML Infrastructure Engineer
ML Infrastructure Engineer

DocVerify • United States

Remote
USD 130,000 - 190,000