Senior ML Engineer - Conversational AI & Evaluation

Apple Inc.; Seattle (WA); On-site; USD 185,000 - 325,000; Full time

Benefits offered by this job

Medical and dental coverage

Stock programs

Relocation assistance

Tuition reimbursement

Job summary

Apple's Siri organization seeks a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. You will deliver offline evaluation insights to drive model development while upholding Apple’s privacy standards, collaborating across teams to curate evaluation datasets for state-of-the-art models.

As part of the SCALE team, you will tackle challenges in evaluating personalized user experiences and define evaluation coverage for LLMs, shaping the next generation of Siri and

Qualifications

• 7+ years of ML experience applied to natural language products.
• Experience managing large-scale ML datasets for training/evaluation.
• Strong Python programming skills.

Responsibilities

• Evaluate model changes using LLMs as judges and assess the naturalness of conversations.
• Create adversarial scenarios with generative AI for robust evaluation.
• Influence next generation Siri and Apple products through datasets.

Skills

Python

Natural language processing

Large-scale data handling

ML for NLP

Education

MS/PhD in Machine Learning, Computer Science, or equivalent

Job description

Apple's Siri organization seeks a highly skilled Senior Machine Learning Engineer specializing in Conversational AI. You will deliver offline evaluation insights to drive model development while upholding Apple’s privacy standards, collaborating across teams to curate evaluation datasets for state-of-the-art models.

As part of the SCALE team, you will tackle challenges in evaluating personalized user experiences and define evaluation coverage for LLMs, shaping the next generation of Siri and