Head of Quality

Toloka; United States; Remote; USD 130,000 - 180,000; Full time

Job summary

Toloka is seeking a Head of Quality to define quality standards and optimize processes across its innovative platform. With a goal to improve quality management on a global scale, successful applicants will have proven leadership experience and a strong background in quality assurance strategies within the AI field.

Qualifications

• Extensive experience in Quality and leading strategies.
• Experience in managing mid to large sized teams.
• Ability to make data driven decisions.

Responsibilities

• Define quality taxonomy to improve quality.
• Integrate quality tracking with client feedback.
• Manage training on quality across teams.

Skills

Quality Improvement Strategies

Leadership Skills

Analytical Skills

AI Training Projects

Data Driven Decisions

Job description

Join to apply for the Head of Quality role at Toloka

Join to apply for the Head of Quality role at Toloka

This range is provided by Toloka. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$130,000.00/yr - $180,000.00/yr

Head of Quality

About Toloka AI

At Toloka AI we create data that powers leading GenAI models and innovations. We work with frontier labs, big tech, renowned AI startups, enterprises and non-profit research organizations worldwide. We use a combination of Experts + Crowd + Tech Platform to teach AI models to reason and evaluate their efficacy and safety. We have experts in more than 50 different domains—from doctors and lawyers to physicists and engineers—and boast one of the most diverse global crowds, representing over 100 countries and speaking 40+ languages. We are a well-funded startup with an enviable portfolio of clients including Anthropic, Amazon, Microsoft, Poolside, Recraft, and Shopify.

Recently, we secured strategic investment led by Bezos Expeditions with participation from Mikhail Parakhin, CTO of Shopify and board advisor to leading GenAI companies, who now serves as our Chairman of the Board. Our remote-first team is globally distributed around the world: USA, UK, the Netherlands, Israel, Czech Republic, Serbia, and more. We are headquartered in Amsterdam.

Head Of Quality - Role Definition

Standardize Quality Definition and Processes

• Define quality taxonomy to measure and improve quality at scale.
• Recommend process builds to optimize quality across pipelines.
• Define standard tools and analytics to utilize in quality management.

Client Management

• Assess client guidelines to align with Toloka quality framework.
• Integrate quality tracking with client feedback to re-train experts at scale.
• Embed quality methodology into acquisition, staffing, training and pipeline builds.

Internal Coordination and Development

• Research quality across clients and best practices in the industry.
• Manage training on quality across teams and experts
• Manage an efficient team structure and coordination of efforts across clients
• Develop QA framework with product and build LLM-enabled QA
• Define the next generation evaluations connected to quality assurance
• Build connectivity with the Agent platform

Skills and Experience Needed

• Extensive experience in Quality, able to demonstrate a deep experience in creating and leading quality improvement strategies
• Experience leading mid to large sized teams, able to demonstrate good leadership skills
• Good analytical skills and experience. Able to make data driven decisions and improvements
• Strong understanding and experience of AI Training projects
• Ability to thrive in a fast moving environment and innovate solutions to new problems.

Seniority level

• Seniority level

  Director

Employment type

• Employment type

  Full-time

Job function

• Job function

  Quality Assurance

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Toloka by 2x

Sign in to set job alerts for “Head of Quality Assurance” roles.

Senior Director, Head of Quality Assurance

United States $230,000.00-$280,000.00 1 week ago

Texas, United States $108,000.00-$129,000.00 3 weeks ago

Director of Quality, Construction - Raleigh

Senior Director, GMP Quality Assurance, Commercial

Senior Director, QA Operations - Viral Gene Therapy (On-Site in College Station, TX)

Director Clinical Quality Assurance - RELO to San Francisco

United States $190,000.00-$220,000.00 1 week ago

Director, Clinical Quality Assurance - RELO to SAN FRAN

United States $200,000.00-$240,000.00 1 week ago

Director/ Executive Director, Development Quality Assurance

United States $180,000.00-$210,000.00 2 weeks ago

Director, Clinical QA Management RWE Clinical Trials - Remote

United States $136,000.00-$231,300.00 1 week ago

Director of Compliance & Quality Assurance

Human Resources Director of Quality Assurance

Texas, United States $108,100.00-$128,600.00 3 weeks ago

Associate Director, Global Pharmacovigilance Quality Management

Director of Pre Sales - QA - Test Automation

Associate Director, Therapeutic Area Quality Lead - Americas/EMEA - Remote

North Carolina, United States 2 weeks ago

Associate Director - Biomarker Operational Quality

Director, Managed Care Quality Analytics - Remote

VP Global Head of Program Management, CDMO

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.