Senior Conversational AI ML Engineer – Real-Time, Grounded

Apple

Cupertino (CA)

On-site

USD 185,000 - 325,000

Full time

16 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Apple, Inc. in Cupertino, CA is seeking a Senior Machine Learning Engineer to own the conversational intelligence layer, including agent planning, tool-calling, and real-time LLM inference. You will work across teams to productionize conversational AI at Apple scale.

The role emphasizes latency-aware development, grounding responses with knowledge graphs, and building evaluation pipelines to maintain accuracy. Strong experience with LLMs, retrieval, and low-latency systems is required.

Qualifications

  • Master's degree in CS/ML/NLP or related field.
  • 7+ years of experience in software or machine learning engineering focusing on conversational AI, search, or LLM systems.
  • Strong programming skills in Go and Python, plus Java or Scala.
  • Hands-on experience building/ shipping conversational AI or dialogue systems.
  • Experience building LLM-powered applications in production with prompt design, tool calls, and orchestration.
  • LLM inference optimization: distillation, quantization, batching, KV-cache tuning, caching.
  • Experience deploying and serving LLMs/ML models in production with TensorRT, TorchServe, etc.
  • Experience with knowledge graphs and low-latency retrieval.
  • Proficiency with PyTorch and Hugging Face ecosystem.
  • Familiarity with AWS and Docker/Kubernetes.
  • Excellent communication and collaboration skills.

Responsibilities

  • Own the agent planning and tool-calling layer; ground responses in retrieval and knowledge graphs.
  • Design conversational flows and intent understanding using LLM- and small-model parsers.
  • Reduce latency and cost through distillation, quantization, batching, and caching; select model size.
  • Develop automated evaluation for conversational quality and CI integration.
  • Define offline metrics and collaborate on A/B tests to validate improvements.
  • Ship models/services to production with versioning, monitoring, and rollback.
  • Collaborate with research, engineers, and product teams to productionize research.

Skills

ML engineering
Go & Python
LLM in production
Knowledge graphs
AWS
Communicator

Education

Master's in CS/ML/NLP
PhD in CS/ML/NLP

Tools

vLLM
SGLang
TensorRT-LLM
ONNX Runtime
PyTorch
Hugging Face transformers

Job description

Apple, Inc. in Cupertino, CA is seeking a Senior Machine Learning Engineer to own the conversational intelligence layer, including agent planning, tool-calling, and real-time LLM inference. You will work across teams to productionize conversational AI at Apple scale.

The role emphasizes latency-aware development, grounding responses with knowledge graphs, and building evaluation pipelines to maintain accuracy. Strong experience with LLMs, retrieval, and low-latency systems is required.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/ML Engineer - GenAI, LLMs & Conversational AI
Senior AI/ML Engineer - GenAI, LLMs & Conversational AI

Apple, Inc. • Sunnyvale (CA)

On-site
USD 150,000 - 278,000
Stock awards
Relocation assistance
Tuition reimbursement
+1
Senior Machine Learning Engineer, Conversational AI - Services Special Projects
Senior Machine Learning Engineer, Conversational AI - Services Special Projects

Apple • Cupertino (CA)

On-site
USD 185,000 - 325,000
Senior ML Engineer: LLMs, Agent Systems & Simulation
Senior ML Engineer: LLMs, Agent Systems & Simulation

Apple, Inc. • Cupertino (CA)

On-site
USD 150,000 - 278,000
Medical and dental coverage
Employee stock programs
Educational reimbursement (tuition)
Senior Conversational AI Engineer – Privacy-First ML
Senior Conversational AI Engineer – Privacy-First ML

Apple, Inc. • Seattle (WA)

On-site
USD 175,000 - 309,000
Stock awards
Employee stock purchase plan
Education reimbursement
+1
ML Engineer - Production AI & Autonomous Agents
ML Engineer - Production AI & Autonomous Agents

Apple, Inc. • Cupertino (CA)

On-site
USD 185,000 - 278,000
Senior ML Engineer — Generative AI & LLM Leader
Senior ML Engineer — Generative AI & LLM Leader

Apple, Inc. • San Francisco (CA)

On-site
USD 185,000 - 325,000
Discretionary bonuses or commission
Relocation
Employee stock programs
Senior ML Platform Engineer – Gen AI & LLM
Senior ML Platform Engineer – Gen AI & LLM

Apple, Inc. • Seattle (WA)

On-site
USD 175,000 - 309,000
Medical and dental coverage
Retirement benefits
Employee stock programs
+1
NLP ML Research Engineer: On-Device AI & Agentic ML
NLP ML Research Engineer: On-Device AI & Agentic ML

Apple, Inc. • Cupertino (CA)

On-site
USD 185,000 - 325,000
Comprehensive medical and dental cover
Retirement benefits
Discounted products and free services
+2
ML Engineer – LLMs, NLP & Generative AI for Search
ML Engineer – LLMs, NLP & Generative AI for Search

Apple • Cupertino (CA)

On-site
USD 180,000 - 260,000
Senior ML Engineer — Scalable AI/LLM Solutions
Senior ML Engineer — Scalable AI/LLM Solutions

Apple Inc. • Cupertino (CA)

Hybrid
USD 216,000 - 325,000
Medical and dental coverage
Retirement benefits
Stock programs and Employee Stock Plan
+1