Senior AI/ML Engineer — Agent RAG & Sandbox Architect

Arc

United States

Remote

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Consultancy-me is seeking a Senior LLM application engineer in the United States to turn architectural foundations into production-ready agents and tools. You will build runtimes, integrate with gateways, and ensure observability and cost-aware decisions across a live system.

You will collaborate with the CPO and core infra, ship initial specialist agents, and establish reusable patterns, evaluation suites, and secure APIs so that Roam-like platforms can extend the foundation.

Qualifications

  • Senior LLM application engineering in production—agents, tools, or RAG systems that other teams depend on.
  • Strong Python; experience with an agent framework and tool protocols; production judgment on evals and observability.

Responsibilities

  • Ratify architecture decisions as records for runtime, sandboxing, data stores, scheduling, and data usage.
  • Build in Python and call Loci tools through gateway with approval before writes.
  • Design and implement reusable agent runtimes: versioned definitions, persistent instances, model selection, sandboxing.
  • Stand up retrieval and RAG over Loci and client context; define grounding, evaluation harnesses, and quality metrics.
  • Ship a first specialist agent over A2A; define evaluation suites, tracing, and model/cost choices for observable production behavior.
  • Interface with application Core alongside engineering leads to share a clear contract and ensure hosting services integration.

Skills

Python
LLM engineering
Agent framework
Observability
Architecture notes

Tools

Google ADK
LangGraph
MCP

Job description

Consultancy-me is seeking a Senior LLM application engineer in the United States to turn architectural foundations into production-ready agents and tools. You will build runtimes, integrate with gateways, and ensure observability and cost-aware decisions across a live system.

You will collaborate with the CPO and core infra, ship initial specialist agents, and establish reusable patterns, evaluation suites, and secure APIs so that Roam-like platforms can extend the foundation.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/ML Engineer
Senior AI/ML Engineer

Arc • United States

Remote
USD 180,000 - 240,000
Remote AI/ML Engineer: LLMs, RAG & AI Agents
Remote AI/ML Engineer: LLMs, RAG & AI Agents

Client • United States

Remote
USD 120,000 - 190,000
Remote-friendly environment
Senior AI Engineer: LLM Architect & Agentic Platforms
Senior AI Engineer: LLM Architect & Agentic Platforms

Plymouth Rock Company • Massachusetts

On-site
USD 135,000 - 200,000
4 weeks accrued paid time off + 9 paid
Free onsite gym at our Boston Location
Tuition Reimbursement
+5
AI Agent Algorithm Engineer — RAG, Planning & Production
AI Agent Algorithm Engineer — RAG, Planning & Production

Momcozy • California

On-site
USD 150,000 - 190,000
Senior AI Engineer & Architect - LLMs, RAG, Agents
Senior AI Engineer & Architect - LLMs, RAG, Agents

Valiant Technologies LLC • Trenton (NJ)

On-site
USD 180,000 - 240,000
AI Agent Engineer - Build Safe, Scalable Agent Systems
AI Agent Engineer - Build Safe, Scalable Agent Systems

FDE Times • United States

Remote
USD 200,000 - 275,000
Equity plan
Remote AI Agent Engineer (LLM & Tooling)
Remote AI Agent Engineer (LLM & Tooling)

FDE Times • United States

Remote
USD 200,000 - 270,000
Equity plan
Remote AI Engineer: LLMs, RAG & Autonomous Agents
Remote AI Engineer: LLMs, RAG & Autonomous Agents

Rochak Digital Private Limited • United States

Remote
USD 40,000 - 60,000
Mid-Senior AI Engineer - Agents & RAG (LLMs)
Mid-Senior AI Engineer - Agents & RAG (LLMs)

United Global Technologies • Menlo Park (CA)

On-site
USD 140,000 - 210,000
Senior AI Engineer: End-to-End LLM Apps, RAG & Agents
Senior AI Engineer: End-to-End LLM Apps, RAG & Agents

Robotic Technologies Automation • San Diego (CA)

On-site
USD 180,000 - 240,000