Senior Data Scientist: Model Risk & Audit Analytics

TikTok; San Jose (CA); On-site; USD 137,000 - 277,000; Full time

Job summary

TikTok is seeking data scientists and AI developers to power continuous auditing and risk identification across verticals. You will deploy data analytics, data science, and ML skills to build analytics products for the audit team.

Join a team evaluating model lifecycles, biases, and security risks, while delivering scalable data solutions and dashboards for audits. The role emphasizes collaboration with stakeholders and leveraging AI for automation.

Qualifications

• Bachelor's degree in a quantitative field (Math/Stats/CS/Econ) required.
• 5+ years in applied data science, ML engineering, or AI research with LLMs.
• Proficient in SQL and Python; experience with ML pipelines and libraries.
• Experience auditing AI/ML models and managing risk in enterprise settings.

Responsibilities

• Evaluate model lifecycle from training to deployment and monitoring.
• Identify bias, fairness issues, hallucinations, security risks; propose remediations.
• Define metrics and validate model performance, calibration and stability.
• Communicate findings clearly to technical and non-technical stakeholders.
• Support audits with data queries, testing strategies and data quality checks.
• Develop and maintain data warehouses to support audit engagements.
• Build ETL pipelines and dashboards for continuous auditing.
• Leverage ML/AI to automate audit processes and surface insights.

Skills

SQL

Python

LLMs

HuggingFace Transformers

TensorFlow

PyTorch

scikit-learn

ML pipelines

Model auditing

Education

Bachelor's degree in quantitative discipline

PhD in quantitative discipline

Tools

AWS

GCP

Azure

Snowflake

Hadoop

Flink

MapReduce

Job description

TikTok is seeking data scientists and AI developers to power continuous auditing and risk identification across verticals. You will deploy data analytics, data science, and ML skills to build analytics products for the audit team.

Join a team evaluating model lifecycles, biases, and security risks, while delivering scalable data solutions and dashboards for audits. The role emphasizes collaboration with stakeholders and leveraging AI for automation.