AI Operations Lead - Remote Automation & QA

Jobgether

Oregon

Hybrid

USD 90,000 - 103,000

Full time

4 days ago

Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Fully remote

40h per week

12-month contract

Job summary

Jobgether is seeking an AI Operations Specialist based in the United States to transform manual review and QA into AI-powered workflows. You will identify automation opportunities, map processes, and develop solutions combining AI with human oversight, collaborating with product, engineering, and legal partners to ensure quality and reliability.

You will design prompts, pipelines, and quality controls, monitor performance, and validate AI outcomes before deployment.

Qualifications

5–7 years in operations, program management, analytics, or related field with proven results.
Hands-on experience with AI tools and delivering AI-powered workflows.
Strong measurement using accuracy, precision, recall, and sampling methods.

Responsibilities

Identify and prioritize AI automation opportunities based on impact and value.
Map workflows and determine tasks suitable for AI vs human intervention.
Design and implement AI-powered workflows, including prompts and monitoring.
Establish quality standards for AI processes and validate performance.
Develop evaluation datasets and test cases to measure AI accuracy.
Partner with product teams to define launch-readiness criteria for AI features.
Translate policies into clear evaluation criteria for reviewers.
Develop labeling guidelines and manage data labeling with real-world data.
Coordinate data labeling and reviews with external vendors, using metrics.
Monitor AI workflows for performance, drift, and issues; apply corrective actions.
Own workstreams from planning to deployment and ongoing monitoring.
Document workflows, methodologies, and lessons learned for reuse.