Machine Learning Researcher: Agentic Post-Training for On-Device Models

Apple, Inc.

Sunnyvale (CA)

On-site

USD 180,000 - 240,000

Full time

8 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Apple, Inc. is seeking researchers to advance agentic post-training for on-device LLMs, developing supervised fine-tuning, RL, and distillation methods with multimodal capabilities. You will build data pipelines, interactive environments, and evaluation tools to push reasoning and tool use while meeting tight latency and energy budgets.

The role emphasizes secure, privacy-preserving deployments and collaboration across hardware, software, and ML teams to deliver impactful on-device experiences.

Qualifications

  • Requires MS or equivalent practical experience in CS/ML.
  • Strong track record with first-author publications or substantial hands-on frontier-model training.
  • Proficiency in Python and PyTorch; ability to design and implement training/evaluation pipelines.

Responsibilities

  • Develop post-training methods for on-device agentic models.
  • Design training data, interactive environments, and evaluation frameworks.
  • Create reward models, verifiers, and graders for long-horizon tasks.
  • Balance latency, memory, energy, and tool-use costs in on-device contexts.
  • Collaborate with hardware and software teams to translate research into Apple products.
  • Publish technical reports and contribute to open-source model releases.

Skills

Python
PyTorch
Research
Experiment design

Education

MS in CS/ML/related field
PhD (preferred) in CS/ML/AI/CV/NLP

Job description

The Video Computer Vision (VCV) organization is an applied research and engineering team developing next-generation multimodal intelligence technologies across Apple products. Within VCV, our team builds intelligent systems that combine multimodal understanding, reasoning, and tool use to deliver compelling user experiences. Our work is deeply integrated into the Apple ecosystem, partnering across hardware, software, and ML teams to deliver real-time, scalable, and privacy-preserving experiences reaching millions of users.

Description

In this role, you will develop post-training methods that turn foundation models into capable, reliable, and efficient agents for on-device execution. You will develop supervised fine-tuning and reinforcement learning methods for agentic models, alongside the training data, interactive environments, reward signals, and evaluations needed to advance reasoning, tool use, and long-horizon tasks. A central research challenge is enabling smaller models to make effective decisions and complete multi-step tasks within tight latency, memory, and energy budgets. You will investigate how to improve reasoning, planning, and tool use while reducing reliance on lengthy generated reasoning and large inference budgets. Research directions may include structured reasoning, adaptive computation, and training objectives that balance task success with computational cost. You will own the projects end to end: identify capability gaps, formulate hypotheses, build training pipelines, conduct rigorous experiments, and translate frontier research into Apple products that deliver meaningful value to users.

Responsibilities
  • Advance agentic post-training for on-device models. Develop supervised fine-tuning, reinforcement learning, preference optimization, and distillation methods that improve reasoning and multi-step tool use in on-device LLMs.
  • Design training data and interactive environments. Build scalable pipelines for trajectory generation, curriculum construction, and hard-example mining. Develop environments that support learning through tool use and multimodal interaction.
  • Design reward functions, verifiers, and graders for complex agent tasks, addressing long-horizon credit assignment, supervision quality, and gaps between reward scores and actual task success.
  • Improve capability under deployment constraints. Research methods that balance task success with latency, memory, energy, and tool-use costs, including structured or compressed reasoning and adaptive computation.
  • Build rigorous evaluations and diagnostics. Measure task success, generalization, reliability, and efficiency. Analyze model outputs and agent trajectories to distinguish modeling limitations from data, reward, environment, and infrastructure issues, and turn findings into targeted improvements.
  • Translate research into Apple experiences. Collaborate with software and hardware teams to integrate and validate agent capabilities under realistic on-device constraints.
  • Drive external research impact. Contribute to research projects from initial hypothesis through experimental validation, publish high-impact technical reports as a core author, and release open-source models that advance agentic post-training and support the broader research community. Example technical reports: "Internalized Visual Thinking for Video Reasoning, Structured Reasoning for Efficient Agentic Search."
Minimum Qualifications
  • MS in Computer Science, Machine Learning, Artificial Intelligence, Computer Vision, Natural Language Processing, or a related field, or equivalent practical experience.
  • A strong research track record demonstrated by either first-author publications at top-tier conferences (such as NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV, ACL, or EMNLP) or substantial hands‑on experience training frontier models, with contributions relevant to foundation models, reinforcement learning, multimodal learning, or agentic systems.
  • Strong programming skills in Python and proficiency with deep learning frameworks such as PyTorch.
  • Demonstrated ability to formulate research hypotheses, implement training and evaluation pipelines, conduct controlled experiments, and draw well-supported conclusions.
Preferred Qualifications
  • PhD in Computer Science, Machine Learning, Artificial Intelligence, Computer Vision, Natural Language Processing, or a related field, or equivalent practical experience. Research focus on foundation models, reinforcement learning, agentic systems, multimodal reasoning, or efficient machine learning.
  • Significant contributions to high-impact technical reports or open-source model releases in agentic post-training, with substantial ownership of research methodology, model training, experimental validation, and technical communication.
  • Experience developing or training agents for tool use and long-horizon tasks.
  • Experience designing interactive training environments, trajectory‑generation pipelines, reward models, or scalable agent evaluations.
  • Exp
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Research Scientist: Multimodal Foundation Models - Architecture, Pre-Training & Distillation
AI Research Scientist: Multimodal Foundation Models - Architecture, Pre-Training & Distillation

Apple, Inc. • Seattle (WA)

On-site
USD 180,000 - 270,000
AIML - Machine Learning Research Lead, RL Agents, MLR
AIML - Machine Learning Research Lead, RL Agents, MLR

Apple, Inc. • Cupertino (CA)

On-site
USD 216,000 - 394,000
Comprehensive medical and dental
Employee stock programs & RSUs
Relocation assistance
+1
Machine Learning Engineer - Proactive
Machine Learning Engineer - Proactive

Apple • Cupertino (CA)

On-site
USD 180,000 - 240,000
Staff Machine Learning Engineer, Apple Cloud AI Platform
Staff Machine Learning Engineer, Apple Cloud AI Platform

Apple, Inc. • Seattle (WA)

On-site
USD 180,000 - 240,000
Sr. Computer Vision and Machine Learning Engineer, Creativity Apps
Sr. Computer Vision and Machine Learning Engineer, Creativity Apps

Apple, Inc. • Cupertino (CA)

On-site
USD 180,000 - 260,000
Remote AI Research Engineer — Agentic Post-Training
Remote AI Research Engineer — Agentic Post-Training

Tether.io • Town of Italy (NY)

On-site
Confidential
Applied Researcher: On-Device Multimodal Reasoning
Applied Researcher: On-Device Multimodal Reasoning

Apple Inc. • Sunnyvale (CA)

On-site
USD 150,000 - 278,000
Member of Technical Staff, Model Training & Post-Training Model Training
Member of Technical Staff, Model Training & Post-Training Model Training

TensorScale AI, Inc. • San Francisco (CA)

On-site
USD 180,000 - 240,000
AIML - ML Researcher, AFM
AIML - ML Researcher, AFM

Apple, Inc. • Cupertino (CA)

On-site
USD 180,000 - 280,000
Senior ML Research Engineer, Post-Training for Personalization
Senior ML Research Engineer, Post-Training for Personalization

Apple Inc. • Cupertino (CA)

On-site
USD 216,000 - 394,000