Enterprise AI Architect - Scale LLM Systems

Empathy Talent; San Francisco (CA); On-site; USD 279,000 - 341,000; Full time

Benefits offered by this job

Wellness benefits starting day 1

Flexible time off

Technology reimbursements

401(k) plan

Twice-yearly in-person offsites across

the U.S.

Job summary

Empathy Talent is seeking a Staff AI Engineer to shape the technical direction of our intelligence layer, defining architecture, standards, and a roadmap for reliable enterprise AI agents.

You’ll lead cross‑functional decisions, drive scalable LLM infrastructure, and mentor senior engineers while delivering high‑impact systems across teams.

Compensation: up to $310,000 base + equity; you’ll partner with Engineering, Product, and Design to advance the AI roadmap and build reusable platforms.

Qualifications

• 8+ years of production software engineering experience.
• ≥3 years leading complex AI/ML systems.
• Deep expertise in TypeScript, Python, and distributed systems.
• Proven experience shipping enterprise-scale LLM-powered products.
• Experience defining retrieval architectures, vector databases, and embedding pipelines.
• Hands-on with modern LLM APIs and agent frameworks including OpenAI, Anthropic, Gemini, LangGraph.

Responsibilities

• Set the architectural direction for agentic systems and the broader intelligence layer.
• Identify and resolve systemic gaps that limit reliability, scalability, or product velocity.
• Make high-leverage technical bets and drive them through implementation.
• Establish evaluation standards, observability infrastructure, and reliability frameworks at scale.
• Own complex, cross-cutting product areas end-to-end.
• Design agent orchestration and retrieval systems for enterprise-grade complexity.
• Lead the evolution of LLM infrastructure, prompts, guardrails, evaluations, and feedback loops.
• Prototype, validate, and harden novel approaches before scaling them across the engineering organization.

Skills

8+ years production software

3+ years AI/ML systems

TypeScript

Python

distributed systems

LLM-powered products

retrieval architectures

vector databases

embedding pipelines

OpenAI API

Anthropic API

Gemini API

LangGraph API

Job description

Empathy Talent is seeking a Staff AI Engineer to shape the technical direction of our intelligence layer, defining architecture, standards, and a roadmap for reliable enterprise AI agents.

You’ll lead cross‑functional decisions, drive scalable LLM infrastructure, and mentor senior engineers while delivering high‑impact systems across teams.

Compensation: up to $310,000 base + equity; you’ll partner with Engineering, Product, and Design to advance the AI roadmap and build reusable platforms.