Senior Data Scientist — Model Risk & Audit Analytics

TikTok; New York (NY); On-site; USD 137,000 - 277,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) with company match

Paid parental leave

Short-term and long-term disability

Life insurance

Wellbeing benefits

10 paid holidays per year

10 paid sick days per year

17 days of Paid Personal Time

Job summary

TikTok is seeking a data science/AI auditing leader to empower continuous auditing across multiple verticals. You will deploy data analytics and ML skills to evaluate model lifecycles, identify vulnerabilities, and drive remediation while partnering with auditors and business stakeholders.

Join a global Internal Audit team that leverages state-of-the-art analytics to assess risk, strengthen controls, and deliver actionable recommendations at scale.

Qualifications

• Bachelor's degree in quantitative field such as Math, Stats, CS, Economics.
• 5+ years in applied data science or AI/ML, with LLMs and ML models.
• Experience designing, deploying, and monitoring large-scale ML models; strong SQL and Python.
• Expertise in model performance metrics including bias and fairness.
• Knowledge of transformer LLMs like GPT, BERT, etc.

Responsibilities

• Audit model lifecycle from training to deployment and monitoring.
• Identify model vulnerabilities and remediation strategies.
• Define and validate metrics including accuracy, F1, calibration.
• Collaborate with stakeholders and communicate findings to technical and non-technical audiences.
• Develop data analytics services and ETL pipelines for audits.

Skills

SQL

Python

LLMs

ML lifecycle

Education

Bachelor's degree in quantitative field

Tools

SQL

Python

Hugging Face Transformers

TensorFlow

PyTorch

scikit-learn

Job description

TikTok is seeking a data science/AI auditing leader to empower continuous auditing across multiple verticals. You will deploy data analytics and ML skills to evaluate model lifecycles, identify vulnerabilities, and drive remediation while partnering with auditors and business stakeholders.

Join a global Internal Audit team that leverages state-of-the-art analytics to assess risk, strengthen controls, and deliver actionable recommendations at scale.