Machine Learning Engineer Graduate (Conversational AI) - 2027 Start

TikTok; San Jose (CA); On-site; USD 128,000 - 317,000; Full time

Job summary

TikTok is seeking a Machine Learning Engineer Graduate (Conversational AI) for a 2027 start in San Jose. The role focuses on building and refining agent runtime, memory systems, and tool integration to support long multi-turn conversations.

Ideal candidates have a strong ML/NLP foundation, hands-on experience with LLMs or agents, and the ability to translate research into production-grade code. A Bachelor's degree in a related field is required, with parallel emphasis on experimentation and

Qualifications

• Bachelor’s degree in CS/EE/Math or related discipline.
• Strong Python and one of C++/Go/Rust/Java.
• Solid ML/DL/NLP fundamentals with hands-on LLM/agent experience.
• Basic statistical literacy (confidence intervals, p-values).
• Ability to turn papers/blogs into working code.
• Experience building runtime, memory/context-management, tool-use agents, or fine-tuned models.

Responsibilities

• Agent runtime orchestration: manage skills, tools, and context; implement loop control, guardrails, and safe fallbacks.
• Develop long-term agent memory and context management with structured playbooks and deterministic curation.
• Apply post-training methods (SFT/DPO/RLHF/RLAIF/RLVR) and distillation for model efficiency.
• Manage Tools, Skills, and MCP: tool APIs, search, governance, and on-demand loading.
• Design evaluation systems: LLM-as-judge, calibration, and robust eval workflows.
• Build self-improving loops: case mining, root-cause, candidate generation, and replay verification.
• Oversee online experimentation with shadow/canary/A-B testing and safe deployment.

Skills

Bachelor's degree in CS/EE/Math

Python

C++/Go/Rust/Java

ML/DL/NLP fundamentals

Read papers into working code

Education

Bachelor’s degree in Computer Science, Electrical Engineering, Mathematics or related discipline

Tools

LLMs / agents runtime harness

vLLM / TensorRT-LLM

MoE / KV / prompt caching

Job description

Machine Learning Engineer Graduate (Conversational AI) - 2027 Start

Location: San Jose

Employment Type: Regular

Job Code: A211317

Share this listing:

Responsibilities

• Agent runtime (harness / agent loop). Orchestrate skills, tools, and context; implement loop control & intervention, progressive disclosure, and behavior-level guardrails. Build the production safety layer - pre-flight budgets and timeout truncation, serve-time gates, shadow / swap-in answer delivery, and safe fallback paths.
• Context & memory for long multi-turn agents. Agentic memory (structured note-taking), context compaction / summarization, context editing / observation masking, and just-in-time (retrieve-then-load) retrieval. Treat context as an evolving, itemized playbook - with structured diffs and a deterministic curator - rather than an ever-growing prompt.
• Post-training & the data flywheel. SFT / DPO / RL to internalize rules into weights (so the prompt gets shorter, not longer), plus distillation to smaller serving models. Turn served conversations into training / eval / retrieval signals.
• Tools, Skills, and MCP. Tools-as-APIs, connectors, skill / tool search for large inventories, and skill-library governance - description conflicts, trigger evals, cross-skill mis-fire matrices, and on-demand loading instead of dumping every definition into context.
• Evaluation you can bet a launch on. LLM-as-judge with human-agreement calibration; statistical rigor - paired comparison, confidence intervals, repeated sampling, pass^k; held-out and time-rolling eval splits with overfitting alarms; cascaded scoring and cross-family judge panels to make evaluation affordable at scale.
• The self-evolving loop. Case mining → automatic root-cause → constrained candidate generation → replay verification against frozen regression sets → canary → flywheel. Build the plumbing that makes it auditable: candidate registry with exact runtime read-back, change lineage, and an archive of rejected candidates you can sample from next round.
• Online experimentation & causal readout. Shadow / canary / A-B, non-inferiority gates, traffic-split health, metric definitions that survive scrutiny, and off-policy counterfactual evaluation where live A/B isn't possible.

Qualifications

• Individuals who are completing or have recently completed a Bachelor’s degree in Computer Science, Electrical Engineering, Mathematics, Statistics or a related discipline
• Strong Python plus one of C++ / Go / Rust / Java
• Solid ML / DL / NLP fundamentals, with genuine hands-on experience with LLMs or agents (coursework, research, internship, competition, open-source, or a serious side project)
• Basic statistical literacy — you can compute a confidence interval, explain what a p-value does and doesn't mean, and tell the difference between "the number went up" and "the system got better"
• Able to read a paper or an engineering blog and turn it into working code
• Have built the runtime, not just called an API - even at research / hobby / competition scale: your own agent loop / harness, a memory / context-management system, a RAG or tool-use agent, or a fine-tuned / post-trained model
• Hands-on experience in any one of the following — depth in one is enough, breadth welcome:
  • Post-training: SFT / DPO / RLHF / RLAIF / RLVR, reward modeling, reward hacking and how to defend against it
  • Agent systems: harness, context engineering, MCP / Skills, sub-agents, tool search
  • Evaluation & experimentation: LLM-as-judge and judge calibration, pass^k, regression suites, A/B and non-inferiority testing, off-policy evaluation
  • Self-improving / evolutionary systems: evolutionary program search, candidate archives and parent sampling, automatic prompt / context optimization, multi-objective (Pareto) selection and credit assignment
  • Inference & serving: vLLM / TensorRT-LLM, MoE, KV / prompt caching, and the cost engineering that comes with it
  • Multilingual NLP
  • Publications (for PhD), strong competition results (ACM-ICPC / Kaggle / ML competitions), or notable open-source contributions
  • Taste for the honest number. We'd rather hire someone who says "this result isn't significant yet" than someone who ships a green dashboard. If you've ever killed your own experiment because the evidence didn't hold up, tell us about it.
  • e-Commerce or multilingual experience is a plus, not required

Job Information

The base salary range for this position in the selected city is $128000 - $316800 annually.

Compensation may vary outside of this range depending on a number of factors, including a candidate’s qualifications, skills, competencies and experience, and location. Base pay is one part of the Total Package that is provided to compensate and recognize employees for their work, and this role may be eligible for additional discretionary bonuses/incentives, and restricted stock units.

Benefits may vary depending on the nature of employment and the country work location. Employees have day one access to medical, dental, and vision insurance, a 401(k) savings plan with company match, paid parental leave, short-term and long-term disability coverage, life insurance, wellbeing benefits, among others. Employees also receive 10 paid holidays per year, 10 paid sick days per year and 17 days of Paid Personal Time (prorated upon hire with increasing accruals by tenure).

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates:

Qualified applicants with arrest or conviction records will be considered for employment in accordance with all federal, state, and local laws including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Our company believes that criminal history may have a direct, adverse and negative relationship on the following job duties, potentially resulting in the withdrawal of the conditional offer of employment:

1. Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;

2. Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems;

3. Exercising sound judgment.

About TikTok

TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.

Why Join Us

Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.

We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

TikTok Accommodation

TikTok is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request

Ready for a career

at TikTok?

Discover a career that energizes and excites you every day.