Senior AI Engineer: Production-Grade LLM Systems

Empathy Talent

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

10 days ago

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Empathy Talent partners with a fast-growing tech company to hire a Senior AI Engineer who will lead production AI systems from concept to production. You’ll design agentic architectures, build evaluation frameworks, and ship reliable AI experiences at scale.

You will own AI capabilities across development, deployment, reliability, and observability, balancing model intelligence with stable software behavior.

Qualifications

  • 3–6+ years of professional software engineering experience building complex production systems.
  • Strong experience with Python and/or TypeScript.
  • Experience with relational databases such as Postgres.
  • Demonstrated experience shipping LLM-powered products or features into production.
  • Hands-on experience building AI agents, agent orchestration, or multi-step LLM workflows.
  • Experience with retrieval pipelines, embeddings, vector databases, and RAG architectures.
  • Familiarity with leading foundation-model APIs and modern AI development tooling.
  • Strong understanding of production software architecture, APIs, data systems, observability, and reliability.

Responsibilities

  • Build Production AI Systems.
  • Design and build agentic systems that automate complex workflows.
  • Orchestrate LLMs, tools, retrieval systems, APIs, and business logic into production-grade apps.
  • Own AI capabilities throughout lifecycle: development, deployment, reliability, performance, observability.
  • Balance model intelligence with predictable software behavior.
  • Develop and optimize agent orchestration, tool use, and reasoning workflows.
  • Build evaluation frameworks, feedback loops, and guardrails to improve AI performance.
  • Design prompts, retrieval pipelines, and orchestration logic.
  • Work with vector databases, embeddings, and modern LLM APIs.
  • Prototype rapidly and turn concepts into scalable systems.

Skills

3–6+ years software engineering
Python
TypeScript
Postgres
LLM-powered products
AI agents
agent orchestration
retrieval pipelines
vector databases
LLM APIs

Tools

LLM APIs
Vector databases
Retrieval pipelines
Embeddings
RAG architectures

Job description

Empathy Talent partners with a fast-growing tech company to hire a Senior AI Engineer who will lead production AI systems from concept to production. You’ll design agentic architectures, build evaluation frameworks, and ship reliable AI experiences at scale.

You will own AI capabilities across development, deployment, reliability, and observability, balancing model intelligence with stable software behavior.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Engineer - Production-Grade LLM & Agentic Systems
Senior AI Engineer - Production-Grade LLM & Agentic Systems

XPENG • San Francisco (CA)

On-site
USD 244,000 - 413,000
Fun environment
Impact on transportation revolution
Cutting-edge technology
Senior AI Engineer: Build Production-Grade LLM Systems
Senior AI Engineer: Build Production-Grade LLM Systems

Innovaccer Analytics • San Francisco (CA)

On-site
USD 230,000 - 340,000
PTO benefits
Parental leave
Rewards & recognition
+1
Senior AI Engineer - LLMs, Agents & Production Systems
Senior AI Engineer - LLMs, Agents & Production Systems

Innovaccer • San Francisco (CA)

On-site
USD 180,000 - 240,000
Generous PTO
Parental Leave
Rewards & Recognition
+1
Senior AI Engineer: Production LLMs & API Systems
Senior AI Engineer: Production LLMs & API Systems

XDI Solutions • Denver (CO)

Hybrid
USD 150,000 - 180,000
Senior AI Platform Engineer: LLMs & Production Systems
Senior AI Platform Engineer: LLMs & Production Systems

CV in • Northern (KY)

Hybrid
USD 140,000 - 200,000
Senior AI Engineer — Production LLM Systems
Senior AI Engineer — Production LLM Systems

CyberCoders • New York (NY)

On-site
USD 220,000 - 280,000
Unlimited PTO
Wellhub Platinum membership
Comprehensive health, dental, and vis​
+1
Senior AI Engineer: Production ML & LLM Systems (Remote)
Senior AI Engineer: Production ML & LLM Systems (Remote)

Latitude • Sacramento (CA)

Hybrid
USD 200,000 - 350,000
Senior AI Engineer
Senior AI Engineer

Empathy Talent • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior AI Engineer - Production LLM EvalOps
Senior AI Engineer - Production LLM EvalOps

LawPro.ai • Town of Texas (WI)

On-site
USD 140,000 - 210,000
Senior AI Research Engineer: Production LLM Systems
Senior AI Research Engineer: Production LLM Systems

Uncover • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 260,000
20 days PTO per year
Parental leave
Rewards & recognition
+1