Head of Quality Assurance Operations

OpenKrill; United States; Remote; USD 180,000 - 260,000; Full time

Job summary

David AI is seeking a Head of Quality Assurance Operations in the United States. You will own quality for all datasets (conversational, TTS, transcription) and manage global contractor relationships, reporting to the Head of Operations.

You will lead the design of language- and region-based quality reviews, drive calibration and throughput, and build dashboards for cost efficiency. This is a senior leadership role requiring 7–10+ years in operations.

Qualifications

• 7 to 10+ years in operations, including 3+ in senior leadership roles.
• Experience running quality operations for large contingent networks across multiple countries.
• Owned quality at scale covering calibration, capacity planning, and spend efficiency.
• You built systems end-to-end, from tooling to contingent workforce sourcing at scale.
• Speech, audio, or linguistic data experience is a strong plus.

Responsibilities

• Own the quality bar across all data ops, including quality standards, calibration, consistency and on-time delivery of datasets.
• Design the quality review structure, organized by language and region, so every dataset gets consistent quality coverage.
• Audit and review the quality of delivered work product across languages, keeping quality benchmarks consistent globally.
• Run quality in languages you don't speak through deliverables from native-speaker and cross-language gold sets.
• Plan capacity against production ramps and own contingent workforce sourcing across many countries.
• Build and own dashboards for quality, throughput, and cost efficiency.
• Manage David AI’s relationships with staffing vendors, service providers, and employer-of-record partners.

Skills

Operations leadership

Contingent workforce management

Quality at scale

Data tooling

Speech/audio data experience

Job description

About David AI

David AI is the first audio data research company. We bring an R&D approach to data-developing datasets with the same rigor AI labs bring to models. Our mission is to bring AI into the real world, and we believe audio is the gateway. Speech is versatile, accessible, and human- fits naturally into everyday life. As audio AI advances and new use cases emerge, high-quality training data is the bottleneck. This is where David AI comes in.

David AI was founded in 2024 by a team of former Scale AI engineers and operators. In less than a year, we’ve brought on most FAANG companies and AI labs as customers. We recently raised a $50M Series B from Meritech, NVIDIA, Jack Altman (Alt Capital), Amplify Partners, First Round Capital and other Tier 1 investors.

Our team is sharp, humble, ambitious, and tight-knit. We’re looking for the best research, engineering, product, and operations minds to join us on our mission to push the frontier of audio AI.

About our Data Operations team

Our Data Operations team powers David AI's Data Factory, transforming raw audio into high-quality training datasets for leading AI labs. Our mandate is to spin up new data pipelines and run them at a massive scale. This means starting from a model capability we want a model to unlock, experimenting with different shapes of data and collection strategies, and validating them with researchers. Once an approach works, we industrialize it, building pipelines that can process audio with reliability, quality, and efficiency. We are relentless operators who thrive in ambiguity, equally comfortable prototyping novel workflows as we are managing large-scale production systems.

About this role

As Head of Quality Assurance Operations, you'll own quality for every dataset David AI ships including but not limited to conversational, TTS, and transcription data, and manage David AI’s relationships with the global contingent workforce, comprising independent contractors and vendor-supplied contributors. You'll report to the Head of Operations and be located in the US.

In this role, you will

• Own the quality bar across all data ops, including quality standards, calibration, consistency and on-time delivery of datasets


• Design the quality review structure, organized by language and region, so every dataset gets consistent quality coverage


• Audit and review the quality of delivered work product across languages, keeping quality benchmarks consistent globally


• Run quality in languages you don't speak through deliverables from native-speaker and cross-language gold sets


• Plan capacity against production ramps and own contingent workforce sourcing across many countries, ensuring each engagement is structured and classified correctly under local law


• Build and own dashboards for quality, throughput, and cost efficiency


• Manage David AI’s relationships with staffing vendors, service providers, and employer-of-record partners

Your background looks like

• 7 to 10+ years in operations, including 3+ in senior leadership roles


• You've run quality operations for large contingent workforce networks across multiple countries


• You've owned quality at scale, across calibration, capacity planning, and spend efficiency


• You built the system yourself, from tooling to contingent workforce sourcing at scale


• Speech, audio, or linguistic data experience is a strong plus