Senior ML Lead: LLM Evaluation & Intelligent Agents

TikTok USDS Joint Venture; San Jose (CA); Sur place; USD 187 000 - 438 000; Plein temps

Résumé du poste

TikTok USDS Joint Venture LLC is seeking a Senior Machine Learning Engineer to lead architecture and execution of our AI Risk & Compliance Intelligence Platform and Intelligent Data Agent Ecosystem.

You will bridge prompt engineering with model-driven reasoning, tackling offline/online evaluation, synthetic data for small-sample scenarios, and agent skill optimization across Data & Engineering workflows.

Qualifications

• 5+ years of software/ML engineering experience with production ML/LLM systems.
• Hands-on with LLM architectures, fine-tuning, RAG, prompt tuning, & agentic frameworks.
• Experience building robust LLM evaluation frameworks and data bootstrap techniques.
• Strong coding skills and production-grade data processing pipelines.

Responsabilités

• Design, build, and scale LLM evaluation architectures with automated datasets and benchmarking.
• Develop synthetic data generation techniques to address data scarcity and test edge cases.
• Create native ML-driven decision models and reasoning abstractions from complex data.
• Architect modular agent skills and tools for DS, Analytics, Data Engineering, and SRE workflows.
• Implement evaluation methods like LLM-as-a-judge and multi-agent benchmarking.
• Provide technical leadership by establishing core ML system design patterns and best practices.

Connaissances

LLM architectures

Prompt tuning

Evaluation frameworks

Production systems

Outils

Data pipelines

ML tooling

Description du poste

TikTok USDS Joint Venture LLC is seeking a Senior Machine Learning Engineer to lead architecture and execution of our AI Risk & Compliance Intelligence Platform and Intelligent Data Agent Ecosystem.

You will bridge prompt engineering with model-driven reasoning, tackling offline/online evaluation, synthetic data for small-sample scenarios, and agent skill optimization across Data & Engineering workflows.