Head of AI Engineering, LLM Systems

hermeneutic research

United States

Remote

USD 190,000 - 260,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

hermeneutic research is hiring a Lead AI Engineer to own and grow the multi-agent research platform used by researchers and traders. The role starts with hands-on system work, writing code and running experiments, and progresses to leading an AI engineering team as the function scales.

You will ensure reliable LLM layers, manage costs, and shape the architecture to improve research outcomes with rigorous, measurable evaluation.

Qualifications

  • 7+ years of software or ML engineering, with 3+ years shipping LLM-backed systems.
  • Experience shipping to production with latency, cost and quality ownership.
  • 2+ years leading engineers while still shipping.
  • Command of inference economics: tokens, caching, routing, structured outputs.
  • Strong Python, including async concurrency.
  • Experience with self-hosted serving (vLLM or similar) and GPU capacity planning.
  • Depth in vector and graph retrieval, built and measured.

Responsibilities

  • Keep the LLM layer reliable: latency budgets, concurrency and queueing, declared degradation modes, structured-output validation and provider failover.
  • Build evaluation tied to research outcomes: offline sets from real queries with outcome labels, online experiments, regression gates on every change, and model-generated confidence calibrated with quantitative research before it reaches a decision.
  • Control cost and routing: per-workload cost attribution, difficulty-based routing between small and frontier models, caching and batching, and the economics of self-hosted serving and GPU capacity.
  • Run model strategy and lifecycle: pinned model versions, replayable test batteries before any change, one-step rollback, provider diversification, and fine-tuning or adapters where they pay.
  • Shape the agent architecture with evidence: ablate and retire components that do not earn their keep, and improve tool use, memory and retrieval only where they move research outcomes.
  • Ground and trace outputs: citation, hallucination controls, audit trails, and the boundary between what a model may assert and what it may only suggest.
  • Build the team: review and mentor engineers now, and hire and lead an AI engineering group as the function grows.

Skills

7+ years software/ML engineering
3+ years shipping LLM-backed systems
2+ years leading engineers
Python programming
async concurrency
self-hosted serving
vector/graph retrieval
inference economics

Tools

vLLM
Self-hosted serving
GPU capacity planning
Adapters
GPU deployment tooling

Job description

hermeneutic research is hiring a Lead AI Engineer to own and grow the multi-agent research platform used by researchers and traders. The role starts with hands-on system work, writing code and running experiments, and progresses to leading an AI engineering team as the function scales.

You will ensure reliable LLM layers, manage costs, and shape the architecture to improve research outcomes with rigorous, measurable evaluation.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Engineer - GenAI & LLM Systems Lead
Senior AI Engineer - GenAI & LLM Systems Lead

US based SaaS company that offers AI-powered business operating system • United States

Remote
USD 180,000 - 280,000
Remote AI Agent Engineer (LLM & Tooling)
Remote AI Agent Engineer (LLM & Tooling)

FDE Times • United States

Remote
USD 200,000 - 270,000
Equity plan
Principal AI Engineer: LLMs & Agentic Systems
Principal AI Engineer: LLMs & Agentic Systems

FactSet Research Systems • New York (NY)

On-site
USD 180,000 - 260,000
Senior AI Research Engineer, Agentic LLM Systems
Senior AI Research Engineer, Agentic LLM Systems

Leadout Capital • Palo Alto (CA)

On-site
USD 180,000 - 260,000
AI Systems Architect & LLM Engineer
AI Systems Architect & LLM Engineer

Sphere Software • United States

Remote
USD 120,000 - 170,000
AI Research Engineer — Production LLM & Agent Systems
AI Research Engineer — Production LLM & Agent Systems

Edra • New York (NY)

On-site
USD 250,000 - 350,000
Equity
Health insurance
Dental plan
+4
AI Engineering Manager: Lead Architect of LLMs & AI
AI Engineering Manager: Lead Architect of LLMs & AI

Procurify • United States

Remote
USD 180,000 - 240,000
Senior AI Engineer: LLM Architect & Agentic Platforms
Senior AI Engineer: LLM Architect & Agentic Platforms

Plymouth Rock Company • Massachusetts

On-site
USD 135,000 - 200,000
4 weeks accrued paid time off + 9 paid
Free onsite gym at our Boston Location
Tuition Reimbursement
+5
Lead AI Architect: Multi-Agent LLM Systems & Orchestration
Lead AI Architect: Multi-Agent LLM Systems & Orchestration

Tekvizor • Pittsburgh

On-site
USD 120,000 - 150,000
Unlimited sick days
Tuition reimbursement
401k with 4% match
Senior AI Research Engineer: LLMs, Multimodal & Agentic AI
Senior AI Research Engineer: LLMs, Multimodal & Agentic AI

Dataminr, Inc. • New York (NY)

Hybrid
USD 155,000 - 228,000
Flexible work arrangements
Company equity
Discretionary bonus
+1