Senior AI/ML Engineer

Arc

United States

Remote

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Consultancy-me is seeking a Senior LLM application engineer in the United States to turn architectural foundations into production-ready agents and tools. You will build runtimes, integrate with gateways, and ensure observability and cost-aware decisions across a live system.

You will collaborate with the CPO and core infra, ship initial specialist agents, and establish reusable patterns, evaluation suites, and secure APIs so that Roam-like platforms can extend the foundation.

Qualifications

  • Senior LLM application engineering in production—agents, tools, or RAG systems that other teams depend on.
  • Strong Python; experience with an agent framework and tool protocols; production judgment on evals and observability.

Responsibilities

  • Ratify architecture decisions as records for runtime, sandboxing, data stores, scheduling, and data usage.
  • Build in Python and call Loci tools through gateway with approval before writes.
  • Design and implement reusable agent runtimes: versioned definitions, persistent instances, model selection, sandboxing.
  • Stand up retrieval and RAG over Loci and client context; define grounding, evaluation harnesses, and quality metrics.
  • Ship a first specialist agent over A2A; define evaluation suites, tracing, and model/cost choices for observable production behavior.
  • Interface with application Core alongside engineering leads to share a clear contract and ensure hosting services integration.

Skills

Python
LLM engineering
Agent framework
Observability
Architecture notes

Tools

Google ADK
LangGraph
MCP

Job description

Turn the agentic foundation from architecture into decisions and running code. You work directly with software engineering team and myself (CPO / cofounder), who owns the agentic system until this hire lands.

What you'll do
  • Ratify the agentic foundation plan as architecture decision records: runtime, sandboxing, data stores, scheduling, how agents use our data and clients data and tools, and how the foundation plugs into our applciation infra.
  • Build in Python (Google ADK or equivalent), calling Loci tools through the gateway (MCP), with approval before any write
  • Design and implement reusable agent runtimes: versioned agent definitions, persistent agent instances, model selection, isolated compute (microVMs / gVisor-class sandboxing or equivalent)
  • Stand up retrieval and RAG over Loci (and customer context where appropriate): grounding, evaluation harnesses, and measurable quality for market and portfolio questions
  • Ship a first specialist agent over A2A; define evaluation suites, tracing, and model/cost choices so production behaviour is observable and improvable
  • Interface with our application ifra Core alongside Alex (Lead Full Stack / Roam OS technical owner, starting 9 Nov) so agents, tools, and host services share a clear contract
  • Deploy agent paths for clients and leave handover so Roam can operate and extend the foundation without you
Must-haves
  • Senior LLM application engineering in production — agents, tools, or RAG systems that other people depend on
  • Strong Python; experience with an agent framework (Google ADK, LangGraph, or similar) and tool protocols (MCP at minimum)Production judgement on evals, observability, and model selection — you measure behaviour, not only demo it
  • Ability to turn an architecture plan into decision records and a staged build that ships through pull requests
  • Comfort with retrieval systems and with exposing agents behind APIs / gateways
Nice to have
  • A2A or other agent-to-agent protocols, agent sandboxing (microVMs, gVisor, or Kubernetes-based platforms), TypeScript for application Core, Kubernetes basics, enterprise identity and tenant-aware tool access, real-estate or structured market-data experience
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Agentic AI Developer
Agentic AI Developer

Xpetize • United States

Remote
USD 120,000 - 180,000
Staff Engineer / AI Builder - Mountain View
Staff Engineer / AI Builder - Mountain View

robotsandpencils • Mountain View (CA)

On-site
USD 180,000 - 260,000
Lead AI Agent Engineer
Lead AI Agent Engineer

EPAM Systems • United States

On-site
USD 180,000 - 240,000
Production-Ready Agentic AI Engineer
Production-Ready Agentic AI Engineer

Trilagen • Bethesda (MD)

Hybrid
USD 120,000 - 160,000
401K
Health Insurance
Dental Insurance
+2
Senior .NET Software Engineer with strong AI Engineering experience
Senior .NET Software Engineer with strong AI Engineering experience

EPAM Systems • United States

Remote
USD 140,000 - 180,000
Principal Engineer & Architect - AI Agent Plaform
Principal Engineer & Architect - AI Agent Plaform

DevSavant Inc. • United States

Remote
USD 180,000 - 240,000
Senior AI Agent Engineer
Senior AI Agent Engineer

EPAM Systems • United States

On-site
USD 150,000 - 210,000
Agentic Engineer
Agentic Engineer

Perform Digital • United States

Remote
USD 140,000 - 200,000
Senior Agentic Engineer
Senior Agentic Engineer

Brahma • United States

Remote
USD 150,000 - 210,000
Chief Forward Deployed Engineer
Chief Forward Deployed Engineer

EPAM Systems Inc • United States

Remote
USD 150,000 - 190,000
Health insurance
401(k) match