Senior ML & AI Research Engineer - LLMs, RAG & Agents

Alldus

San Francisco (CA)

On-site

USD 180,000 - 240,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity
Competitive salary

Job summary

Alldus is hiring an ML/AI Research Engineer in San Francisco to lead design, training, evaluation and optimization of agent-native AI systems. You will push the boundaries of LLMs, vector search, graph reasoning and reinforcement learning to build the intelligence layer on top of an enterprise data fabric.

You will fine-tune open-source LLMs, build RAG pipelines, develop agent architectures, and optimize deployment for low latency and high throughput across cloud and on-premise infrastructure.

Qualifications

  • Experience fine-tuning open-source LLMs for enterprise-grade apps.
  • Experience building training datasets and evaluation frameworks for LLM systems.
  • Familiarity with memory, retrieval, and multi-step reasoning in AI systems.
  • Strong understanding of deployment trade-offs including latency and batching.
  • Experience with RAG pipelines and vector databases.

Responsibilities

  • Fine-tune and evaluate open-source LLMs (e.g. LLaMA 3, Mistral, Falcon) for enterprise use.
  • Build and optimize RAG pipelines (LangChain, LangGraph, LlamaIndex, Dust).
  • Develop and iterate on agent architectures (ReAct, AutoGPT, BabyAGI, OpenAgents).
  • Design embedding-based memory systems with efficient retrieval strategies.
  • Implement RL pipelines (RLHF, DPO, PPO) to improve agent behavior.
  • Create scalable evaluation frameworks, including synthetic evaluations and explainability tooling.
  • Own model observability, drift detection and alignment across production systems.
  • Optimize inference latency and GPU utilization across cloud and on-premise.

Skills

Fine-tuning LLMs
RLHF / DPO
LLM evaluation
Agent architectures
Memory systems design
Retrieval optimization
GPU inference optimization
Production deployment

Tools

HuggingFace
DeepSpeed
vLLM
LoRA/QLoRA
LangChain
LangGraph
LlamaIndex
Weaviate
Qdrant
FAISS

Job description

Alldus is hiring an ML/AI Research Engineer in San Francisco to lead design, training, evaluation and optimization of agent-native AI systems. You will push the boundaries of LLMs, vector search, graph reasoning and reinforcement learning to build the intelligence layer on top of an enterprise data fabric.

You will fine-tune open-source LLMs, build RAG pipelines, develop agent architectures, and optimize deployment for low latency and high throughput across cloud and on-premise infrastructure.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ML / AI Research Engineer
ML / AI Research Engineer

Alldus • San Francisco (CA)

On-site
USD 180,000 - 240,000
Equity
Competitive salary
Enterprise AI Research Engineer LLMs RAG & Agents
Enterprise AI Research Engineer LLMs RAG & Agents

Fabrion • San Francisco (CA)

On-site
USD 180,000 - 260,000
Equity
Senior AI Agent & LLM Architect — Hybrid (SF)
Senior AI Agent & LLM Architect — Hybrid (SF)

Genixbit • San Francisco (CA)

Hybrid
USD 185,000 - 245,000
Senior AI Research Engineer: LLMs, Multimodal & Agentic AI
Senior AI Research Engineer: LLMs, Multimodal & Agentic AI

Dataminr, Inc. • New York (NY)

Hybrid
USD 155,000 - 228,000
Flexible work arrangements
Company equity
Discretionary bonus
+1
Remote AI/ML Engineer: LLMs, RAG & AI Agents
Remote AI/ML Engineer: LLMs, RAG & AI Agents

Client • United States

Remote
USD 120,000 - 190,000
Remote-friendly environment
Senior AI Engineer Databricks: LLMs & Agent Frameworks
Senior AI Engineer Databricks: LLMs & Agent Frameworks

Adesso • San Francisco (CA)

On-site
USD 150,000 - 210,000
AI Agent Engineer — LLMs, Safe Automation & Scale
AI Agent Engineer — LLMs, Safe Automation & Scale

TRM Labs • San Francisco (CA)

On-site
USD 180,000 - 260,000
Research Engineer - RL Infrastructure & Agentic AI
Research Engineer - RL Infrastructure & Agentic AI

Storm3 • San Francisco (CA)

On-site
USD 150,000 - 210,000
Medical Insurance
Dental Insurance
Vision Insurance
Applied ML Engineer (LLMs & RAG)
Applied ML Engineer (LLMs & RAG)

Alldus • San Francisco (CA)

On-site
USD 150,000 - 230,000
Senior AI Agent & LLM Architect
Senior AI Agent & LLM Architect

GenixBit Labs Pvt. Ltd. • San Francisco (CA)

Hybrid
USD 185,000 - 245,000