Staff AI Engineer: Production LLM Lead

Overnox

United States

Remote

USD 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Overnox is seeking a high-impact leader to define the technical direction for production-grade LLM systems, covering agents, retrieval-augmented generation, and evaluation pipelines for demanding enterprise environments. You will mentor engineers, architect scalable solutions, and partner with cross-functional teams to translate business requirements into reliable AI capabilities and durable production quality.

This role is a bar-raiser for engineering culture.

Qualifications

  • Extensive experience shipping LLM-based systems to production at scale.
  • Deep understanding of agents, RAG pipelines, and evaluation methodologies.
  • Strong software engineering fundamentals with emphasis on reliability and operability.
  • Proven ability to set technical direction and influence engineering culture.
  • Experience operating complex AI systems in demanding customer environments.

Responsibilities

  • Define and continuously raise the technical bar for production LLM system design and operations.
  • Architect solutions across agent workflows, RAG pipelines, and evaluation frameworks.
  • Guide the path from prototype to reliable production for enterprise use cases.
  • Establish engineering patterns and review practices adopted by the broader team.
  • Partner with cross-functional peers to translate business requirements into working AI capabilities.
  • Mentor engineers and contribute to long-term technical strategy.

Skills

Production LLMs
Agents
RAG pipelines
Evaluation methods
Reliability
Operability
Technical leadership

Job description

Overnox is seeking a high-impact leader to define the technical direction for production-grade LLM systems, covering agents, retrieval-augmented generation, and evaluation pipelines for demanding enterprise environments. You will mentor engineers, architect scalable solutions, and partner with cross-functional teams to translate business requirements into reliable AI capabilities and durable production quality.

This role is a bar-raiser for engineering culture.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/ML Engineer - Production LLM & RAG Solutions
Senior AI/ML Engineer - Production LLM & RAG Solutions

Overnox • United States

Remote
USD 150,000 - 220,000
AI Engineer — Production-Grade LLM & Agent Systems
AI Engineer — Production-Grade LLM & Agent Systems

Awareson Sp. z o.o. • United States

Remote
USD 120,000 - 160,000
Staff AI Engineer - Architect of Production LLM Systems
Staff AI Engineer - Architect of Production LLM Systems

Harnham • San Francisco (CA)

On-site
USD 180,000 - 240,000
Staff AI Engineer
Staff AI Engineer

Overnox • United States

Remote
USD 180,000 - 260,000
Senior AI Engineer: Production LLMs, RAG & Agent Workflows
Senior AI Engineer: Production LLMs, RAG & Agent Workflows

Optivus Technologies • United States

Remote
USD 140,000 - 210,000
Senior AI Production Engineer: LLMs & Agent Workflows
Senior AI Production Engineer: LLMs & Agent Workflows

Acceler • United States

Remote
USD 140,000 - 190,000
LLM & GenAI Production Engineer
LLM & GenAI Production Engineer

Evlo AI • Minneapolis (MN)

On-site
USD 140,000 - 190,000
Client-Facing AI Engineer — Production LLMs & GenAI
Client-Facing AI Engineer — Production LLMs & GenAI

scalr • San Francisco (CA)

Hybrid
USD 200,000 - 300,000
Senior AI Engineer: LLM Evaluation, Production & Optimization
Senior AI Engineer: LLM Evaluation, Production & Optimization

LawPro.ai • North Carolina

On-site
USD 140,000 - 190,000
Staff AI Software Engineer - Lead LLM & Full-Stack
Staff AI Software Engineer - Lead LLM & Full-Stack

GoodLeap • San Francisco (CA)

On-site
USD 180,000 - 240,000
Bonus