GenAI Model Assurance Specialist

TikTok USDS Joint Venture; New York (NY); On-site; USD 99,000 - 196,000; Full time

Job summary

TikTok USDS Joint Venture LLC seeks an AI Model Assurance Analyst to operate GenAI oversight, manage intake submissions, drive evaluation dossiers, and support risk and safety processes. The role partners with legal, safety, and engineering to ensure compliant, independent testing and evidence delivery.

You will own change-detection tooling, incident remediation collaboration, and monthly/quarterly oversight reporting while maintaining independence and rigorous SLAs. On-site role in NY area.

Qualifications

• Bachelor's degree in a technical, policy, or risk-adjacent field, or equivalent practical experience.
• 3+ years in operations, program management, or model-risk / model-ops with recurring cross-functional workflows and SLAs.
• Direct knowledge of generative AI / LLM systems, content moderation, or safety operations.
• Ability to read evaluation dossiers and challenge materiality classifications on substance.
• Experience with ticketed intake and approval workflows (Jira / Meego).
• Proven ability to drive cross-functional partners to a decision on a fixed clock.
• Strong written communication for SOPs, memos, and oversight reports.

Responsibilities

• Manage intake queue and progression of GenAI model releases; validate submissions and drive SLAs.
• Classify submissions as material, non-material, or emergency and route to evaluation teams.
• Prepare approval decisions for Content Assurance and log conditional approvals.
• Operationalize change-detection tooling and triage unnotified-change alerts.
• Codify performance envelope for each approval node against standards.
• Track alerts with T&S; run joint triage and log outcomes.
• Support incident response and co‑author remediation plans with IR teams.
• Feed audit evidence pipeline and track weekly completion against requests.
• Produce JV oversight reports on adoptions, incidents, and remediation.
• Lead weekly T&S / AISI triage and quarterly deep-dives and annual reviews.
• Track KPIs and surface trends to leadership.
• Contribute to model assurance evaluations and testing SOPs.
• Contribute to dashboards, release pipelines, and notification loops.

Skills

GenAI / LLM systems

Cross‑functional leadership

Jira / workflow tooling

SLA management

Audit readiness

Policy & safety operations

Structured evidence packaging

Education

Bachelor's degree in technical/policy/risk-adjacent field

Tools

Jira

Meego

Job description

TikTok USDS Joint Venture LLC seeks an AI Model Assurance Analyst to operate GenAI oversight, manage intake submissions, drive evaluation dossiers, and support risk and safety processes. The role partners with legal, safety, and engineering to ensure compliant, independent testing and evidence delivery.

You will own change-detection tooling, incident remediation collaboration, and monthly/quarterly oversight reporting while maintaining independence and rigorous SLAs. On-site role in NY area.