AI Operations Lead (Human-in-the-Loop) - California-based

Welo Data; California (MO); On-site; USD 100,000 - 130,000; Full time

Benefits offered by this job

Free breakfast, lunch, and dinner

Comprehensive Medical, Dental, and Vision coverage

15 days of paid time off

Access to micro-kitchens and rooftop parks

Free shuttles and transport benefits

Job summary

Welo Data is looking for a Data Quality Lead in California to manage teams overseeing AI model evaluations. This full-time on-site role involves leading Data Quality Analysts, owning the quality loop, and translating AI guidelines into structured workflows. The ideal candidate has 5-8 years in Data Quality or AI/ML operations and 2+ years in team management. Comprehensive benefits include gourmet dining, medical coverage, and wellness programs.

Qualifications

• 5-8 years of experience in Data Quality, QA, or AI/ML operations.
• 2+ years of experience managing teams in a high-scale data or AI environment.
• Ability to balance speed with rigorous quality standards.

Responsibilities

• Lead and mentor a specialized team of Data Quality Analysts.
• Own the end-to-end quality loop including audits and calibrations.
• Translate AI guidelines into structured direction for teams.
• Align with global stakeholders on quality standards.

Skills

Data Quality Management

Team Leadership

Strategic Planning

Operational Agility

Technical Interest in AI/ML

Job description

Lead the Teams Shaping the Future of AI – On-Site [CA]

Are you a strategic leader who thrives at the intersection of data quality and people operations? Welo Data is seeking a Data Quality Lead to oversee high-impact teams of analysts dedicated to AI model evaluation.

This isn’t just a management role—it’s an opportunity to define how quality is measured in a human-in-the-loop environment. You will act as the bridge between technical stakeholders and analyst teams, translating complex AI guidelines into clear, actionable operational excellence.

The Mission: Quality Leadership at Scale

• Team Architecture: Lead and mentor a specialized team of Data Quality Analysts, fostering growth and managing high-performance output.
• Quality Ownership: Own the end-to-end quality loop, including audits, calibrations, and the identification of model performance trends.
• Strategic Translation: Turn ambiguous, evolving AI guidelines into structured direction for your teams.
• Stakeholder Partnership: Act as the primary representative for your team, aligning with global stakeholders on quality standards and program goals.
• Operational Innovation: Drive continuous improvement across tooling, evaluation methods, and hiring for specialized linguistic talent.

Project Details

• Job Title: AI Operations Lead
• Employment Type: W2 Full-Time Employee
• Hours: 40 hrs/week
• Location: California (On-site) — San Francisco, Sunnyvale, or Burlingame

Premium Perks & Benefits

This role offers more than just a paycheck—it includes a world-class workspace experience.

• Gourmet Dining: Free breakfast, lunch, and dinner with a wide variety of cuisines.
• Wellness & Insurance: Comprehensive Medical, Dental, and Vision coverage + 401(k) and HSA.
• Time Off: 15 days of combined Paid Sick/Holiday time + Memorial Day and Labor Day.
• Campus Culture: Access to micro-kitchens, premium coffee, and unique features like rooftop nature parks.
• Commuter Support: Free shuttles, transport benefits, and bike-to-work perks.

Who We’re Looking For

• Industry Veteran: 5–8 years of experience in Data Quality, QA, or AI/ML operations.
• Proven Leader: 2+ years of experience managing teams in a high-scale data or AI environment.
• Strategic Mindset: Ability to "zoom out" to see patterns while maintaining deep attention to detail.
• Operational Agility: Comfortable navigating ambiguity and balancing speed with rigorous quality standards.
• Technical Interest: A genuine curiosity about how human feedback shapes the behavior of Large Language Models (LLMs).