Remote Director of Quality & AI Compliance

LILT; Boston (MA); Hybrid; USD 180,000 - 240,000; Full time

Job summary

LILT seeks a Director of Quality to own our quality system end to end, from standards and audits to continual improvement of AI-native workflows. You will shape the quality function as a proactive partner across Customer Success, Production, Research and Product, driving measurable results in agent evaluation, automation, and compliance.

You will lead a team including a Quality Manager and Coordinators, define governance for high-risk content, and collaborate with stakeholders to ensure quality

Qualifications

• Hands-on experience designing, building and running LLM-based agents in production.
• Experience turning quality data into actionable metrics and preventive controls.
• Proven experience improving LLM output quality.
• Led audits (internal/external) and quality programs; certifications a plus.
• Experience with structured CI (RCA, CAPA, KPI reviews).
• Experience managing and developing people.
• Ability translate customer quality requirements into governance and acceptance criteria.

Responsibilities

• Lead the Quality team as Quality Agent leader across orgs.
• Partner with Research and Product on AI workflows and model improvements.
• Own audits, compliance programs, and SOP maintenance for AI workflows.
• Advise customers on quality, cost, and speed trade-offs with appropriate workflows.
• Drive continuous improvement and KPIs across the organization.
• Partner with Ops to embed quality in delivery pipelines.
• Oversee staffing and playbooks for AI-driven quality management.

Skills

Agent design and build

Data-driven quality management

LLM model improvement

Quality systems management

Structured CI (RCA, CAPA, KPI)

People management

Customer advisory & cross-functional

Tools

Python

SQL

Job description

LILT seeks a Director of Quality to own our quality system end to end, from standards and audits to continual improvement of AI-native workflows. You will shape the quality function as a proactive partner across Customer Success, Production, Research and Product, driving measurable results in agent evaluation, automation, and compliance.

You will lead a team including a Quality Manager and Coordinators, define governance for high-risk content, and collaborate with stakeholders to ensure quality