ML Evaluation Engineer: Adversarial Testing & Multi-Turn QA

Apple Inc.; Culver City (CA); On-site; USD 139,500 - 258,100; Full time

Benefits offered by this job

Comprehensive medical and dental coverage

Employee stock purchase plan

Educational reimbursement

Job summary

Apple Inc. is seeking an ML Engineer in Culver City, California, to work on automated evaluation systems for AI features. The role involves defining evaluation methods, building adversarial test suites, and collaborating with engineering teams to ensure quality across products. Candidates must have a Bachelor's in Computer Science or a related field and 4+ years of experience in ML evaluation. Benefits include health coverage, stock options, and a competitive salary ranging from $139,500 to $258,100 depending on experience.

Qualifications

• 4+ years of experience building ML evaluation systems.
• Experience independently defining evaluation architecture for AI.
• Experience designing adversarial or red-teaming test methodologies.

Responsibilities

• Define and own the automated evaluation approach for AI features.
• Build adversarial test suites targeting model failure modes.
• Develop stress test protocols for performance validation.

Skills

Machine Learning

Python

Evaluation Architecture

Adversarial Testing

Multi-turn Evaluation

Education

Bachelor’s degree in Computer Science, Machine Learning, or related field

Tools

PyTorch

TensorFlow

Job description

Apple Inc. is seeking an ML Engineer in Culver City, California, to work on automated evaluation systems for AI features. The role involves defining evaluation methods, building adversarial test suites, and collaborating with engineering teams to ensure quality across products. Candidates must have a Bachelor's in Computer Science or a related field and 4+ years of experience in ML evaluation. Benefits include health coverage, stock options, and a competitive salary ranging from $139,500 to $258,100 depending on experience.