Product ML Engineer

Alpaca Research

Cambridge (MA)

On-site

USD 140,000 - 200,000

Full time

8 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Alpaca Research in Cambridge, MA is seeking an ML engineer to bridge language models with complete systems, focusing on memory, tool use, and agent architectures. You will tune models, design robust pipelines, and evaluate performance across long tasks and real-world scenarios.

You’ll work at the intersection of ML research and building production-ready systems, experimenting with inference-time techniques and memory management to deliver reliable local AI capabilities.

Qualifications

  • Experience with modern language models and transformers.
  • Experience with training and inference techniques for language models.
  • Experience building LLM agents, tool use, and planning.
  • Understanding memory architectures and long-context processing.
  • Ability to work independently in experimental settings.

Responsibilities

  • Fine-tune and optimize language models for tool use.
  • Develop agent harnesses and tool-use architectures.
  • Build retrieval and persistent memory systems.
  • Experiment with quantization and inference-time optimizations.
  • Create benchmarks for agent capabilities and real-world tasks.
  • Prototype new ideas and integrate successful approaches into production.

Skills

ML fundamentals
Agentic systems
Memory & context
Model optimization
Post-training
Research mindset
Independence

Tools

PyTorch
Quantization

Job description

Who we are

Today, AI is something you rent. Alpaca is building the full stack of hardware, software, models, and applications together to make it something you own.

We are developing a new computer architecture that breaks the economics keeping frontier models trapped in datacenters. On top of that, we’re building a platform of models, applications, and services that give that hardware meaning.

Personal AI is moving from the datacenter to the desk, and we are driving that change.

Our team is based in Cambridge, MA.

About the role

We want to make local AI models capable of doing far more than answering questions. Our goal is to build intelligent systems that can understand their users, remember information over time, use tools, and reliably accomplish complex tasks on their behalf.

We are looking for an ML engineer to help bridge the gap between what a model can do on its own and what it can accomplish as part of a complete system. You’ll work across model optimization, post-training, agent architectures, memory systems, and evaluation to make our AI more capable, efficient, and reliable.

This is a role for someone who enjoys both ML research and building real systems. You should be comfortable fine-tuning models, experimenting with inference-time techniques, designing agent harnesses, and developing new approaches to managing context and memory. You’ll have the opportunity to experiment with ideas, measure what works, and bring improvements directly into products used by real people.

What you’ll do

Improve our models: Fine-tune, distill, and optimize language models for tool use, instruction following, and complex agentic tasks.

Build agent systems: Develop harnesses, tool-use architectures, planning and execution loops, and other techniques that make models more capable and reliable.

Engineer memory and context: Build retrieval, persistent memory, context compression, and management systems that allow agents to work effectively across long tasks and conversations.

Optimize inference: Experiment with quantization, speculative decoding, and inference-time techniques to improve model quality, speed, and efficiency on local hardware.

Evaluate and iterate: Develop benchmarks and evaluations for agent capabilities, long-horizon reliability, memory, and real-world task performance.

Research and implement: Explore new papers, algorithms, and techniques, rapidly prototype promising ideas, and integrate successful approaches into production.

Who we’re looking for

Strong ML fundamentals: Experience with modern language models, transformers, PyTorch, and the training and inference techniques behind them.

Agentic systems experience: You’ve built or experimented with LLM agents, tool calling, planning, retrieval, or multi-step reasoning systems.

Memory and context engineering: Understanding of long-context processing, memory architectures, and techniques for working within limited context windows.

Model optimization: Familiarity with quantization, efficient inference, and the tradeoffs between model quality, latency, and compute.

Experience with post-training: Familiarity with supervised fine-tuning, reinforcement learning, distillation, or other techniques for improving model behavior.

Research-minded engineering: You enjoy reading papers, implementing new ideas, and turning research into working software.

Independence: You take ownership of ambiguous problems, move quickly, and thrive in an experimental environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product ML Engineer — Local AI, Agents & Memory
Product ML Engineer — Local AI, Agents & Memory

Alpaca Research • Cambridge (MA)

On-site
USD 140,000 - 200,000
AI/ML Engineer
AI/ML Engineer

RiskForce LLC • United States

On-site
USD 120,000 - 180,000
Member of Technical Staff, ML Engineer
Member of Technical Staff, ML Engineer

Physical Superintelligence • Boston (MA)

Hybrid
USD 140,000 - 190,000
Software Engineer, Compute Infrastructure
Software Engineer, Compute Infrastructure

Alpaca Research • Cambridge (MA)

On-site
USD 150,000 - 210,000
Staff Machine Learning Engineer
Staff Machine Learning Engineer

Primer.ai • Pasadena (CA)

On-site
USD 180,000 - 260,000
Member of Technical Staff, ML Engineer
Member of Technical Staff, ML Engineer

Acceler8 Talent • Massachusetts

Hybrid
USD 180,000 - 240,000
Member of Technical Staff - ML Systems
Member of Technical Staff - ML Systems

NextToken AI Inc. • Mountain View (CA)

On-site
USD 180,000 - 250,000
AI Engineer
AI Engineer

TechDigital Group • San Jose (CA)

On-site
USD 140,000 - 210,000
Machine Learning Engineer (Agentic AI Platform)
Machine Learning Engineer (Agentic AI Platform)

Barker Staffing Solutions LLC • Mountain View (CA)

On-site
USD 180,000 - 240,000
Senior AI Engineer
Senior AI Engineer

Equs, Inc. • United States

Remote
USD 180,000 - 240,000