ML Infra Engineer — Scale AI Training Compute

Alpaca Research

Cambridge (MA)

On-site

USD 120,000 - 180,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Alpaca in Cambridge, MA is hiring an ML infra engineer to oversee the training infrastructure for our NLP and Robotics research teams. You will set up and scale compute resources, enforce efficient utilization, and work with compute vendors to secure competitive rates.

You will make compute resources easy for researchers to use, manage access, and collaborate with researchers to tailor infrastructure to their workflows while maintaining CI/CD, logging, and telemetry.

Qualifications

  • Strong communications skills and independence in owning projects.
  • Familiar with building testing pipelines, CI/CD, logging/telemetry for tracking ML infra use.

Responsibilities

  • Setting up and scaling our compute resources.
  • Enforcing efficient compute utilization.
  • Communicating with compute vendors to get us the most competitive rates.
  • Making compute resources easy for researchers to use.
  • Managing permissions & onboarding/offboarding users.
  • Collaborate with researchers to set up infrastructure around usage and develop tooling to match workflows.

Skills

Strong communication
Independence
Project ownership

Tools

AWS
GCP
Azure
Slurm
Kubernetes

Job description

Alpaca in Cambridge, MA is hiring an ML infra engineer to oversee the training infrastructure for our NLP and Robotics research teams. You will set up and scale compute resources, enforce efficient utilization, and work with compute vendors to secure competitive rates.

You will make compute resources easy for researchers to use, manage access, and collaborate with researchers to tailor infrastructure to their workflows while maintaining CI/CD, logging, and telemetry.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML Infrastructure Engineer
ML Infrastructure Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 120,000 - 180,000
Software Engineer, Compute Infrastructure for AI Platforms
Software Engineer, Compute Infrastructure for AI Platforms

Alpaca Research • Cambridge (MA)

On-site
USD 150,000 - 210,000
Product ML Engineer — Local AI, Agents & Memory
Product ML Engineer — Local AI, Agents & Memory

Alpaca Research • Cambridge (MA)

On-site
USD 140,000 - 200,000
Software Engineer, Compute Infrastructure
Software Engineer, Compute Infrastructure

Alpaca Research • Cambridge (MA)

On-site
USD 150,000 - 210,000
Senior ML Infra Engineer — Scalable Training & Serving
Senior ML Infra Engineer — Scalable Training & Serving

People Culture Talent • San Francisco (CA)

On-site
USD 190,000 - 230,000
Staff ML Engineer: Scale AI Infra & Realm-X
Staff ML Engineer: Scale AI Infra & Realm-X

AppFolio, Inc. • Denver (CO)

Hybrid
USD 200,000 - 275,000
ML Infra Engineer: Scale & Optimize Large-Scale Training
ML Infra Engineer: Scale & Optimize Large-Scale Training

Physical Intelligence • San Francisco (CA)

On-site
USD 180,000 - 240,000
ML Infra Engineer: Petabyte-Scale Training & Data Pipelines
ML Infra Engineer: Petabyte-Scale Training & Data Pipelines

Avala AI, Inc. • San Francisco (CA)

Hybrid
USD 170,000 - 250,000
Equity
Health insurance
Dental insurance
+3
ML Infrastructure Engineer – Scale & Production (Hybrid)
ML Infrastructure Engineer – Scale & Production (Hybrid)

Acceler8 Talent • Cambridge (MA)

Hybrid
USD 140,000 - 210,000
ML Infrastructure Engineer — From Research to Production
ML Infrastructure Engineer — From Research to Production

Acceler8 Talent • Cambridge (MA)

Hybrid
USD 150,000 - 190,000