AI Platform Lead - Production LLM & Tooling

present of AI

United States

On-site

USD 200,000 - 320,000

Full time

19 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Ontra is seeking a Senior Platform Lead to own the shared search and AI platform that other engineers rely on. You will guide retrieval, model access, evaluation, and agent tooling, balancing roadmap decisions with strong technical leadership.

The role emphasizes hands-on engineering and people judgment, shaping architecture, and coaching engineers through complex projects. You’ll decide what to build vs. buy while ensuring security and data privacy in production LLM workflows.

Qualifications

  • Hands-on software engineering experience.
  • Experience running a platform used by multiple teams.
  • Ability to coach engineers and lead architectural decisions.
  • Familiarity with retrieval, evaluation tooling, and agent frameworks.

Responsibilities

  • Own and lead the shared search and AI platform used by other engineers.
  • Shape roadmap, architecture, and implementation decisions; balance build vs. buy.
  • Set quality bars, security, and data privacy considerations for production systems.
  • Mentor and guide senior engineers to deliver scalable, reliable platform capabilities.

Skills

Hands-on engineering
Technical leadership
Platform ownership
Coaching engineers

Job description

Ontra is seeking a Senior Platform Lead to own the shared search and AI platform that other engineers rely on. You will guide retrieval, model access, evaluation, and agent tooling, balancing roadmap decisions with strong technical leadership.

The role emphasizes hands-on engineering and people judgment, shaping architecture, and coaching engineers through complex projects. You’ll decide what to build vs. buy while ensuring security and data privacy in production LLM workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Manager, Engineering
Senior Manager, Engineering

present of AI • United States

On-site
USD 200,000 - 320,000
Senior AI Platform Lead: Architect & Build Production LLMs
Senior AI Platform Lead: Architect & Build Production LLMs

OpenLoop • United States

Hybrid
USD 180,000 - 240,000
Equity
Competitive compensation
Health benefits
+2
Senior AI Platform Architect — LLM Systems & Enterprise Infra
Senior AI Platform Architect — LLM Systems & Enterprise Infra

Anblicks Inc. • Addison (TX)

On-site
USD 180,000 - 240,000
Senior Engineering Manager, AI Foundations & Search (On-site NYC)
Senior Engineering Manager, AI Foundations & Search (On-site NYC)

Ontra, LLC • New York (NY)

On-site
USD 180,000 - 240,000
Twice yearly team offsites
Paid flexible time off
Parental leave and benefits
+3
Staff AI Engineer - LLM in Production
Staff AI Engineer - LLM in Production

Ontra, LLC • New York (NY)

Hybrid
USD 180,000 - 240,000
Twice yearly team offsites for in‑P 1
Paid flexible time off policy
Paid parental leave and benefits
+4
AI Platform Architect — LLM Infrastructure & Scale
AI Platform Architect — LLM Infrastructure & Scale

DroneDeploy, Inc. • Austin (TX)

On-site
USD 233,000 - 321,000
Equity compensation
Bonus incentives
Senior Platform Engineer - AI, Compliance & Scalable LLMs
Senior Platform Engineer - AI, Compliance & Scalable LLMs

Anblicks Inc. • Dallas (TX)

Hybrid
USD 180,000 - 240,000
AI Platform Engineering Lead
AI Platform Engineering Lead

Compeer Financial • Naperville (IL)

Hybrid
USD 133,000 - 180,000
Hybrid work options
Flexible schedules
401k match
+8
Senior AI Platform Engineer - Build & Own Remote Platform
Senior AI Platform Engineer - Build & Own Remote Platform

JustMarkets • United States

Remote
USD 180,000 - 250,000
20 paid vacation days per year
10 paid sick leave days per year
Public holidays as per list
+5
AI Platform Lead — Enterprise LLM & Secure Automation
AI Platform Lead — Enterprise LLM & Secure Automation

Visionist, Inc. • Laurel (MD)

On-site
USD 187,000 - 264,000
Merit increases
Performance-based bonuses
4 weeks PTO + 12 holidays + comp time
+4