GenAI Model Assurance & Release Specialist

TikTok USDS Joint Venture; San Jose (CA); On-site; USD 120,000 - 180,000; Full time

Job summary

TikTok USDS Joint Venture is seeking an AI Model Assurance Analyst to serve as the operational backbone of our GenAI oversight program. You will manage risk, change management, evidence pipelines, and independent validation to ensure releases meet safety commitments.

You will drive intake, evaluation, and decision packages, coordinating with legal, safety, and engineering teams while maintaining independence and adherence to SLAs.

Responsibilities

• Manage intake queue and progression of GenAI model and feature releases; validate submission completeness and drive SLAs.
• Classify submissions as material vs. non-material vs. emergency and route to evaluation teams
• Prepare approval-decision packages for the Content Assurance lead and log conditional approvals against post-launch monitoring commitments.
• Operationalize change-detection tooling and triage unnotified-change alerts
• Codify the performance envelope for each approval node against independent testing standards
• Watch alerts routing into the Content Assurance queue; run joint triage; log outcomes
• Support incident response; co-author remediation plans and post-incident reviews with teams
• Feed the audit evidence pipeline; track artifact readiness against evidence requests weekly
• Produce standing JV oversight reports on updates, incidents, SLA breaches, and remediation progress
• Drive weekly joint T&S / AISI triage, quarterly deep-dives, and annual program reviews
• Track program KPIs and surface trends to leadership
• Contribute to model assurance evaluation refreshes and the 'white glove' testing service for partner product teams
• Contribute to AI Model Assurance Dashboard, release pipeline automation, and notification loops across partners

Skills

GenAI oversight

Change management

Incident response

Job description

TikTok USDS Joint Venture is seeking an AI Model Assurance Analyst to serve as the operational backbone of our GenAI oversight program. You will manage risk, change management, evidence pipelines, and independent validation to ensure releases meet safety commitments.

You will drive intake, evaluation, and decision packages, coordinating with legal, safety, and engineering teams while maintaining independence and adherence to SLAs.