Director of Quality

present of AI; Boston (MA); On-site; USD 90,000 - 130,000; Full time

Job summary

present of AI is seeking a quality leader to own the complete quality system, from ISO audits to AI agents that verify content. You will build and deploy language model agents in production, and write Python or SQL to turn quality data into actionable metrics.

You will manage a small QA team, conduct audits, root-cause analysis, and communicate risk tradeoffs to customers and executives in a fast-growing AI translation company.

Qualifications

• Owns the full quality system, from audits and ISO to AI agents that check work.
• Experience building and running language model agents in production.
• Writes Python or SQL to turn quality data into metrics.
• Leads audits, root-cause analysis and corrective actions.
• Manages a small team and communicates tradeoffs to customers and executives.

Responsibilities

• Design, test, and monitor quality AI agents.
• Coordinate audits and maintain ISO certifications.
• Develop quality metrics and reports for stakeholders.
• Advise customers on quality, cost and speed tradeoffs.
• Mentor and manage the quality team.

Skills

Quality systems

Audits

Root-cause analysis

Team leadership

Customer advisory

Risk assessment

Python

SQL

Communication

Education

Quality management certification

Tools

Salesforce

Job description

This role owns the whole quality system for a translation company, from audits and ISO certifications to the AI agents that now check work. A strong candidate has built and run language model agents in production, can write Python or SQL to turn quality data into useful metrics, and has led audits and root cause work. They also manage a small team and can explain quality, cost and speed tradeoffs to customers and executives.

How it fits the AI era

Much of the routine checking and coordination in quality work is shifting to AI agents, so the job is as much about designing, testing and monitoring those agents as about running reviews. What stays human is judging risk, deciding where a person must still review the work, owning audits, and earning trust with customers in regulated or high stakes content.

How it builds AI experience

The role offers direct experience building and evaluating quality agents, moving from a single agent to multi-agent setups, and feeding findings back into model and product improvements at a company built around AI translation. Someone short on this could build a small agent that checks text against set criteria, write a test set for it, and track how well it performs.

Worth showing

• Production LLM agents built
• Python and SQL quality metrics
• Audit and ISO leadership
• Root cause and corrective actions
• Customer advisory on quality tradeoffs

This is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.

About LILT

LILT provides an AI-powered platform for enterprise translation and localization, per the company.

Tools mentioned: Python, SQL, machine learning, Salesforce