Senior Data Scientist: AI Audit & Risk Analytics

TikTok; Los Angeles (CA); On-site; USD 130,000 - 263,000; Full time

Job summary

TikTok Internal Audit is seeking data scientists and AI developers to power continuous auditing and risk discovery across multiple verticals. You will deploy engineering, data analytics and ML skills to build analytics products for audit teams and scale testing insights.

You will partner with auditors to design data queries, build data warehouses, and create dashboards while ensuring robust evaluation, fairness, and compliance across models.

Qualifications

• Bachelor's degree in a quantitative discipline.
• 5+ years professional experience in applied data science, machine learning engineering, or AI research, especially with LLMs.
• Hands-on experience deploying and monitoring large-scale ML models with SQL and Python.
• Expertise in model performance metrics, hallucination measurement, and fairness/bias assessment.
• Knowledge of transformer-based LLM architectures and classical ML algorithms.
• Experience auditing AI/ML models in corporate, regulatory, or advisory contexts.

Responsibilities

• Audit model lifecycles from training to deployment and monitoring for quality, performance, fairness and risk.
• Identify model vulnerabilities (bias, fairness violations, security risks) and propose remediation.
• Define and assess model performance metrics and calibration.
• Collaborate with data partners and stakeholders to communicate findings and risk assessments.
• Develop data analytics services, data warehouses, and automated audit tests.
• Build ETL pipelines and dashboards to support audit use cases.
• Advance AI-driven automation to scale audit testing and insights.
• Pursue ongoing development in data analytics, ML, AI, and company products.

Skills

SQL

Python

ML model auditing

LLMs

Model evaluation

Stakeholder comms

Education

Bachelor's degree in quantitative discipline

PhD in quantitative discipline (preferred)

Tools

Hugging Face Transformers

TensorFlow

PyTorch

scikit-learn

AWS

Snowflake

Job description

TikTok Internal Audit is seeking data scientists and AI developers to power continuous auditing and risk discovery across multiple verticals. You will deploy engineering, data analytics and ML skills to build analytics products for audit teams and scale testing insights.

You will partner with auditors to design data queries, build data warehouses, and create dashboards while ensuring robust evaluation, fairness, and compliance across models.