Head of Engineering & ML Platform (B2B SaaS)

LlamaIndex

San Francisco (CA)

On-site

USD 180,000 - 280,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

LlamaIndex, Inc. is seeking an experienced engineering leader to drive execution, technical direction, hiring, and team growth for its B2B AI/document understanding platform.

You will closely collaborate with leadership and product teams to decide what to build, how to build it, and how to deliver reliable software to customers. This hands-on role requires reviewing code and architecture, debugging production issues, and guiding model training, serving, and deployment strategies across services,

Qualifications

  • Leadership experience managing multiple engineering teams at a B2B SaaS scale.
  • Hands-on engineering capability with code review, architecture, and debugging.
  • Strong product judgment balancing speed, correctness, and security.
  • Clear written and spoken communication with technical teams and leadership.

Responsibilities

  • Lead and develop our engineering team, setting clear priorities, ownership, and accountability.
  • Partner with leadership to translate customer needs into a focused roadmap and deliver software predictably.
  • Stay involved in architecture, code reviews, production debugging, and implementing critical changes.
  • Set technical direction across services, APIs, data pipelines, and ML infrastructure for maintainability.
  • Collaborate with ML engineers on model training, evaluation, deployment, and production operations.
  • Guide model serving decisions considering latency, throughput, GPU usage, capacity, reliability and cost.
  • Improve engineering practices for testing, observability, security, incident response, and releases.
  • Hire strong engineers, coach leaders, and cultivate a culture of direct communication and accountability.

Job description

LlamaIndex, Inc. is seeking an experienced engineering leader to drive execution, technical direction, hiring, and team growth for its B2B AI/document understanding platform.

You will closely collaborate with leadership and product teams to decide what to build, how to build it, and how to deliver reliable software to customers. This hands-on role requires reviewing code and architecture, debugging production issues, and guiding model training, serving, and deployment strategies across services,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Platform Engineering Tech Lead Manager — AI & B2B SaaS
Platform Engineering Tech Lead Manager — AI & B2B SaaS

LlamaIndex, Inc. • San Francisco (CA)

On-site
USD 210,000 - 330,000
Head of Engineering
Head of Engineering

LlamaIndex • San Francisco (CA)

On-site
USD 180,000 - 280,000
03 Technical Lead Manager - Platform Engineering San Francisco
03 Technical Lead Manager - Platform Engineering San Francisco

LlamaIndex, Inc. • San Francisco (CA)

On-site
USD 210,000 - 330,000
Llama AI Platform Engineer (Remote) - Production ML
Llama AI Platform Engineer (Remote) - Production ML

Performacentric • United States

Remote
USD 120,000 - 190,000
Remote-first work environment
Professional growth opportunities
Applied AI Research Engineer - Document Understanding
Applied AI Research Engineer - Document Understanding

LlamaIndex, Inc. • San Francisco (CA)

On-site
USD 180,000 - 250,000
LlamaIndex - Mid-Market Sales Manager / Director
LlamaIndex - Mid-Market Sales Manager / Director

deCircle • San Francisco (CA)

On-site
USD 120,000 - 160,000
Remote ML Engineer for Llama AI Platform
Remote ML Engineer for Llama AI Platform

Performacentric • Denver (CO)

Remote
USD 100,000 - 130,000
Competitive compensation
Professional growth opportunities
Remote-first work environment
Platform Architect & Backend Lead — AI/LLM
Platform Architect & Backend Lead — AI/LLM

Tech Ladies® • New York (NY)

Hybrid
USD 180,000 - 260,000
Medical insurance
Dental insurance
Vision insurance
+5
AI Platform Engineering Lead - Cloud & LLMs
AI Platform Engineering Lead - Cloud & LLMs

PMG • Dallas (TX)

Hybrid
USD 180,000 - 280,000
Annual bonus program
Healthcare coverage
Generous time off
+5
Principal AI Engineer
Principal AI Engineer

VERISIGN • Reston (VA)

On-site
USD 180,000 - 260,000