Product ML Engineer — Local AI, Agents & Memory

Alpaca Research

Cambridge (MA)

On-site

USD 140,000 - 200,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Alpaca Research in Cambridge, MA is seeking an ML engineer to bridge language models with complete systems, focusing on memory, tool use, and agent architectures. You will tune models, design robust pipelines, and evaluate performance across long tasks and real-world scenarios.

You’ll work at the intersection of ML research and building production-ready systems, experimenting with inference-time techniques and memory management to deliver reliable local AI capabilities.

Qualifications

  • Experience with modern language models and transformers.
  • Experience with training and inference techniques for language models.
  • Experience building LLM agents, tool use, and planning.
  • Understanding memory architectures and long-context processing.
  • Ability to work independently in experimental settings.

Responsibilities

  • Fine-tune and optimize language models for tool use.
  • Develop agent harnesses and tool-use architectures.
  • Build retrieval and persistent memory systems.
  • Experiment with quantization and inference-time optimizations.
  • Create benchmarks for agent capabilities and real-world tasks.
  • Prototype new ideas and integrate successful approaches into production.

Skills

ML fundamentals
Agentic systems
Memory & context
Model optimization
Post-training
Research mindset
Independence

Tools

PyTorch
Quantization

Job description

Alpaca Research in Cambridge, MA is seeking an ML engineer to bridge language models with complete systems, focusing on memory, tool use, and agent architectures. You will tune models, design robust pipelines, and evaluate performance across long tasks and real-world scenarios.

You’ll work at the intersection of ML research and building production-ready systems, experimenting with inference-time techniques and memory management to deliver reliable local AI capabilities.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Product ML Engineer
Product ML Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 140,000 - 200,000
ML Infra Engineer — Scale AI Training Compute
ML Infra Engineer — Scale AI Training Compute

Alpaca Research • Cambridge (MA)

On-site
USD 120,000 - 180,000
Staff ML Engineer — Agent Memory & Reasoning
Staff ML Engineer — Agent Memory & Reasoning

Wand AI • Palo Alto (CA)

On-site
USD 180,000 - 250,000
Systems ML Engineer — High-Performance AI (Cambridge)
Systems ML Engineer — High-Performance AI (Cambridge)

Transfyr Bio • Cambridge (MA)

On-site
USD 150,000 - 230,000
Low-cost health insurance
HSA
401K with matching
+1
Memory AI Research Engineer: Prototyping to Production
Memory AI Research Engineer: Prototyping to Production

ENGRAM Lab • San Francisco (CA)

On-site
USD 120,000 - 180,000
ML Infrastructure Engineer
ML Infrastructure Engineer

Alpaca Research • Cambridge (MA)

On-site
USD 120,000 - 180,000
Software Engineer, Compute Infrastructure for AI Platforms
Software Engineer, Compute Infrastructure for AI Platforms

Alpaca Research • Cambridge (MA)

On-site
USD 150,000 - 210,000
Real-Time ML Engineer: Memory Retrieval & Production
Real-Time ML Engineer: Memory Retrieval & Production

Engramme • San Francisco (CA)

On-site
USD 140,000 - 200,000
Staff ML Engineer — Memory & Agent Retrieval
Staff ML Engineer — Memory & Agent Retrieval

Zep AI • San Francisco (CA)

On-site
USD 180,000 - 260,000
Machine Learning Engineer
Machine Learning Engineer

Engramme • San Francisco (CA)

On-site
USD 140,000 - 200,000