Senior AI Engineer: LLM Orchestration & Real-Time Interviews

Qualitate

New York (NY)

On-site

USD 180,000 - 240,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Health coverage
Flexible PTO
Paid holidays

Job summary

Qualitate is building the AI-native primary intelligence platform for enterprises, investment firms, and asset managers. We automate expert research end-to-end, turning thousands of interviews into structured, queryable intelligence in real time.

The Senior Applied AI Engineer will shape the LLM and retrieval systems at the core of our AI Moderator. You will own the orchestration layer, optimize latency, and collaborate with product and data teams to ship scalable AI-powered insights from

Qualifications

  • 5+ years building and shipping applied AI/ML systems in production.
  • Deep hands-on LLM experience: prompt design, retrieval-augmented generation, and multi-model tooling.
  • Strong backend engineering in Python/TypeScript with production APIs/microservices.
  • Vector database and retrieval systems experience at scale.

Responsibilities

  • Own the LLM orchestration layer powering real-time interviews.
  • Instrument evals, monitoring, and guardrails for production AI systems.
  • Build production APIs and services to turn raw interview data into structured insights.
  • Collaborate with our research team to ship AI-powered assets.
  • Work cross-functionally with product and data engineering.

Skills

LLM orchestration
Python/TypeScript
Vector database
Agentic / multi-turn systems
APIs & microservices
ETL / data engineering

Tools

Deepgram
AssemblyAI
Whisper

Job description

Qualitate is building the AI-native primary intelligence platform for enterprises, investment firms, and asset managers. We automate expert research end-to-end, turning thousands of interviews into structured, queryable intelligence in real time.

The Senior Applied AI Engineer will shape the LLM and retrieval systems at the core of our AI Moderator. You will own the orchestration layer, optimize latency, and collaborate with product and data teams to ship scalable AI-powered insights from

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior AI Platform Engineer - Lead LLM Orchestration (Remote)
Senior AI Platform Engineer - Lead LLM Orchestration (Remote)

CaptivateIQ • United States Virgin Islands

On-site
USD 180,000 - 260,000
Senior AI Platform Engineer: LLMs & Production Systems
Senior AI Platform Engineer: LLMs & Production Systems

CV in • Northern (KY)

Hybrid
USD 140,000 - 200,000
Senior Applied AI Engineer - LLM & Agent Workflows
Senior Applied AI Engineer - LLM & Agent Workflows

Apt • Dallas (TX)

On-site
USD 120,000 - 190,000
Senior AI Engineer: Production LLMs & API Systems
Senior AI Engineer: Production LLMs & API Systems

XDI Solutions • Denver (CO)

Hybrid
USD 150,000 - 180,000
Senior AI Platform Engineer: LLM Workflows & Production
Senior AI Platform Engineer: LLM Workflows & Production

SB Energy • Redwood City (CA)

On-site
USD 160,000 - 190,000
Medical, Dental & Vision
401(k) Match
Paid Time Off & Holidays
+6
Senior AI Systems Engineer - LLM Orchestration & Infra
Senior AI Systems Engineer - LLM Orchestration & Infra

LAM RESEARCH Corporation • Fremont (CA)

Hybrid
USD 141,000 - 307,000
AI Engineer — Agentic LLMs & Production Systems
AI Engineer — Agentic LLMs & Production Systems

Jobtailor • Houston (TX)

On-site
USD 140,000 - 170,000
Senior AI Engineer: Build Production-Grade LLM Systems
Senior AI Engineer: Build Production-Grade LLM Systems

Innovaccer Analytics • San Francisco (CA)

On-site
USD 230,000 - 340,000
PTO benefits
Parental leave
Rewards & recognition
+1
Lead AI Platform Architect: LLM Orchestration & MLOps
Lead AI Platform Architect: LLM Orchestration & MLOps

Luxoft • Irvine (CA)

On-site
USD 180,000 - 280,000
Applied AI Engineer - LLM Orchestration & Production AI
Applied AI Engineer - LLM Orchestration & Production AI

Radley James • San Francisco (CA)

On-site
USD 180,000 - 275,000