Senior AI Engineer: LLM Orchestration & Real-Time Interviews

Qualitate; New York (NY); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Health coverage

Flexible PTO

Paid holidays

Job summary

Qualitate is building the AI-native primary intelligence platform for enterprises, investment firms, and asset managers. We automate expert research end-to-end, turning thousands of interviews into structured, queryable intelligence in real time.

The Senior Applied AI Engineer will shape the LLM and retrieval systems at the core of our AI Moderator. You will own the orchestration layer, optimize latency, and collaborate with product and data teams to ship scalable AI-powered insights from

Qualifications

• 5+ years building and shipping applied AI/ML systems in production.
• Deep hands-on LLM experience: prompt design, retrieval-augmented generation, and multi-model tooling.
• Strong backend engineering in Python/TypeScript with production APIs/microservices.
• Vector database and retrieval systems experience at scale.

Responsibilities

• Own the LLM orchestration layer powering real-time interviews.
• Instrument evals, monitoring, and guardrails for production AI systems.
• Build production APIs and services to turn raw interview data into structured insights.
• Collaborate with our research team to ship AI-powered assets.
• Work cross-functionally with product and data engineering.

Skills

LLM orchestration

Python/TypeScript

Vector database

Agentic / multi-turn systems

APIs & microservices

ETL / data engineering

Tools

Deepgram

AssemblyAI

Whisper

Job description

Qualitate is building the AI-native primary intelligence platform for enterprises, investment firms, and asset managers. We automate expert research end-to-end, turning thousands of interviews into structured, queryable intelligence in real time.

The Senior Applied AI Engineer will shape the LLM and retrieval systems at the core of our AI Moderator. You will own the orchestration layer, optimize latency, and collaborate with product and data teams to ship scalable AI-powered insights from