ML / AI Research Engineer

Alldus

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Equity
Competitive salary

Job summary

Alldus is hiring an ML/AI Research Engineer in San Francisco to lead design, training, evaluation and optimization of agent-native AI systems. You will push the boundaries of LLMs, vector search, graph reasoning and reinforcement learning to build the intelligence layer on top of an enterprise data fabric.

You will fine-tune open-source LLMs, build RAG pipelines, develop agent architectures, and optimize deployment for low latency and high throughput across cloud and on-premise infrastructure.

Qualifications

  • Experience fine-tuning open-source LLMs for enterprise-grade apps.
  • Experience building training datasets and evaluation frameworks for LLM systems.
  • Familiarity with memory, retrieval, and multi-step reasoning in AI systems.
  • Strong understanding of deployment trade-offs including latency and batching.
  • Experience with RAG pipelines and vector databases.

Responsibilities

  • Fine-tune and evaluate open-source LLMs (e.g. LLaMA 3, Mistral, Falcon) for enterprise use.
  • Build and optimize RAG pipelines (LangChain, LangGraph, LlamaIndex, Dust).
  • Develop and iterate on agent architectures (ReAct, AutoGPT, BabyAGI, OpenAgents).
  • Design embedding-based memory systems with efficient retrieval strategies.
  • Implement RL pipelines (RLHF, DPO, PPO) to improve agent behavior.
  • Create scalable evaluation frameworks, including synthetic evaluations and explainability tooling.
  • Own model observability, drift detection and alignment across production systems.
  • Optimize inference latency and GPU utilization across cloud and on-premise.

Skills

Fine-tuning LLMs
RLHF / DPO
LLM evaluation
Agent architectures
Memory systems design
Retrieval optimization
GPU inference optimization
Production deployment

Tools

HuggingFace
DeepSpeed
vLLM
LoRA/QLoRA
LangChain
LangGraph
LlamaIndex
Weaviate
Qdrant
FAISS

Job description

Our client, a venture-backed AI Startup, is hiring a talented ML/AI Research Engineer to join their team in San Francisco. The successful candidate will lead the design, training, evaluation and optimization of agent-native AI systems, working at the cutting edge of LLMs, vector search, graph reasoning and reinforcement learning to build the intelligence layer on top of their enterprise data fabric.

Responsibilities
  • Fine-tune and evaluate open-source LLMs (e.g. LLaMA 3, Mistral, Falcon, Mixtral) for enterprise-grade applications.

  • Build and optimize RAG pipelines using tools such as LangChain, LangGraph, LlamaIndex or Dust.

  • Develop and iterate on agent architectures (ReAct, AutoGPT, BabyAGI, OpenAgents) using real-world enterprise workflows.

  • Design embedding-based memory systems with efficient, high-performance retrieval strategies.

  • Implement reinforcement learning pipelines (RLHF, DPO, PPO) to improve agent behavior and decision-making.

  • Create scalable evaluation frameworks, including synthetic evaluations, trace captureand explainability tooling.

  • Own model observability, drift detection and alignment strategies across production systems.

  • Optimize inference latency and GPU utilization across cloud and on-premise infrastructure.

Skillset
  • Strong experience fine-tuning open-source LLMs using frameworks such as HuggingFace, DeepSpeed, vLLM, FSDP and LoRA/QLoRA.

  • Hands-on experience with modern alignment techniques, including SFT, RLHF and DPO pipelines.

  • Proven ability to build high-quality training datasets and robust evaluation frameworks for LLM systems.

  • Deep understanding of scaling and optimization trade-offs, including batching, context windows, precision and quantization.

  • Experience building and deploying production-grade RAG systems.

  • Familiarity with orchestration and retrieval tools such as LangChain, LangGraph and LlamaIndex, and vector databases (Weaviate, Qdrant, FAISS).

  • Experience working across structured (SQL, graph) and unstructured data sources.

  • Experience designing agent-based systems with memory, tool use, and multi-step reasoning.

  • Strong understanding of agent workflows (e.g. Plan-Act-Reflect), including self-correction and multi-agent systems.

  • Expertise in inference and retrieval optimization, including chunking strategies, reranking, and low-latency deployment (e.g. vLLM, TGI).

Benefits
  • Salary: $180k - $240k

  • Equity.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML/AI Research Engineer — Agentic AI Lab (Founding Team)
ML/AI Research Engineer — Agentic AI Lab (Founding Team)

Fabrion • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
Senior ML & AI Research Engineer - LLMs, RAG & Agents
Senior ML & AI Research Engineer - LLMs, RAG & Agents

Alldus • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Competitive salary
Senior AI Agent & LLM Architect
Senior AI Agent & LLM Architect

GenixBit Labs Pvt. Ltd. • San Francisco (CA)

Hybrid
USD 185,000 - 245,000
AI Agents Applied Research/Engineering Lead - Vice President
AI Agents Applied Research/Engineering Lead - Vice President

JPMorgan Chase & Co. • New York (NY)

On-site
USD 180,000 - 240,000
AI Agents Applied Research/Engineering Lead - Vice President
AI Agents Applied Research/Engineering Lead - Vice President

Testing Site - JPMC • New York (NY)

On-site
USD 180,000 - 280,000
Lead Research Scientist, LLM Agents & Systems
Lead Research Scientist, LLM Agents & Systems

NeoCognition • Palo Alto (CA)

On-site
USD 120,000 - 150,000
AI Engineer (Agentic AI & LLMs)
AI Engineer (Agentic AI & LLMs)

Rise Technical Recruitment Ltd • United States

On-site
USD 180,000 - 240,000
Medical Insurance
PTO
Enterprise AI Research Engineer LLMs RAG & Agents
Enterprise AI Research Engineer LLMs RAG & Agents

Fabrion • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
Founding AI Engineer
Founding AI Engineer

Alldus International Consulting Ltd • San Francisco (CA)

On-site
USD 120,000 - 200,000
Salary DOE
Equity
AI Agents Applied Engineer - Senior Associate
AI Agents Applied Engineer - Senior Associate

Testing Site - JPMC • New York (NY)

On-site
USD 160,000 - 240,000