AI Governance Architect: Scalable, Safe ML Systems

AI Pulse; San Jose (CA); On-site; USD 254,000 - 480,000; Full time

Job summary

TikTok is seeking a Software Architect – AI Governance in San Jose to design and implement scalable, high‑performance governance systems across the full ML lifecycle—from data ingestion and training to evaluation, deployment and online inference.

The role translates evolving privacy, safety and regulatory requirements into concrete platform capabilities and partners with ML platform, research, product, privacy and security teams to deliver reliable, compliant solutions at TikTok scale.

Qualifications

• Bachelor's or Master's degree in Computer Science or related field.
• Experience with large-scale distributed systems, databases, messaging, streaming, and caching.
• Hands-on ML lifecycle experience at production scale (training pipelines, model registries, online serving).
• Expertise in data and/or model governance for training and deployment (lineage, access control, evaluation, release gates).
• Experience addressing Generative AI risks (prompt injection, data leakage, memorization, safety).
• Experience with microservices and containerization (Docker, Kubernetes) and cloud platforms (AWS or GCP).
• Agile development and DevOps practices; strong communication and collaboration.

Responsibilities

• Design and implement scalable, reliable, high-performance systems for data and model governance across the full ML lifecycle — data ingestion, training, evaluation, deployment, and online inference.
• Architect controls for large-scale model training and deployment: training-data lineage and provenance, dataset approval and taxonomy, model registries, evaluation gates, and safe-release workflows.
• Develop innovative solutions to tackle emerging risks in Generative AI — including prompt-injection defense, data leakage and memorization mitigation, output safety filtering, agentic-system guardrails, watermarking, and provenance signals.
• Partner with ML platform and research teams to embed governance hooks (policy checks, PII/PNS filtering, red-team evaluations) directly into training and serving paths without regressing model quality or throughput.
• Collaborate with privacy, security, and legal to ensure systems comply with applicable regulations (GDPR, CCPA, EU AI Act, sector‑specific rules) and with TikTok's own commitments on responsible AI.
• Drive the technical roadmap for AI governance platform capabilities; identify and evaluate new techniques, tools, and research that strengthen the governance posture at scale.
• Provide technical leadership and mentorship to engineers across the organization on AI governance, data governance, and generative‑AI risk topics.

Education

Bachelor's or Master's degree in Computer Science or related field

Distributed systems

Databases

Messaging & streaming

Caching

ML lifecycle (production scale)

Model governance

Data governance

Generative AI risk

Prompt injection defense

Data leakage mitigation

Output safety

Agentic safety

DevOps / Agile

Communication & collaboration

Tools

Docker

Kubernetes

AWS

GCP

Job description

TikTok is seeking a Software Architect – AI Governance in San Jose to design and implement scalable, high‑performance governance systems across the full ML lifecycle—from data ingestion and training to evaluation, deployment and online inference.

The role translates evolving privacy, safety and regulatory requirements into concrete platform capabilities and partners with ML platform, research, product, privacy and security teams to deliver reliable, compliant solutions at TikTok scale.