AI Operations Lead — Remote & Impactful AI Work

Horizontal Talent; San Francisco (CA); Remote; USD 90,000 - 130,000; Full time

Job summary

Horizontal Talent seeks an AI Operations Specialist for a remote, 12-month engagement. You will help identify AI projects with the largest business impact, map current processes, and design AI-enhanced workflows with human-in-the-loop involvement where needed.

You will build prompts, pipelines, and labeling guidelines, run large-scale labeling with vendors, and calibrate AI judgments against human reviews. Strong ops background and AI experience are required, with familiarity in SQL or Python

Qualifications

• 5-7 years in operations, program management, analytics, consulting or applied AI with responsibility for results.
• Experience using AI to move business metrics via workflows, automation or analysis.
• Comfort with numbers: accuracy, precision, recall, sampling; SQL and notebooks helpful.
• Curiosity about how work gets done, and ability to measure processes and improve them.
• Experience with quality controls such as QA or audits.
• Clear written communication and ability to work with business leads, PMs and engineers.

Responsibilities

• Assist in deciding which AI projects will drive business impact and justify them.
• Map current processes and design AI-enabled workflows with human-in-the-loop where needed.
• Write prompts, set up pipelines, and monitor quality to prevent drift.
• Create test data and calibrate model judgments against human reviews.
• Define go/no-go criteria with product and policy teams and provide evidence for decisions.
• Write labeling guidelines with SMEs and produce human-verified labels at scale.

Skills

Operations

Program management

Analytics

Applied AI

Communication

Independent work

Quality assurance

Tools

SQL

Python

APIs

Job description

Horizontal Talent seeks an AI Operations Specialist for a remote, 12-month engagement. You will help identify AI projects with the largest business impact, map current processes, and design AI-enhanced workflows with human-in-the-loop involvement where needed.

You will build prompts, pipelines, and labeling guidelines, run large-scale labeling with vendors, and calibrate AI judgments against human reviews. Strong ops background and AI experience are required, with familiarity in SQL or Python