AI Evaluation Engineer for LLM & Multimodal Systems

Apple Inc.; Cupertino (CA); Hybrid; USD 150,000 - 225,000; Full time

Benefits offered by this job

Medical and dental coverage

Employee stock programs

Stock purchase plan

Relocation assistance

Tuition reimbursement

Discounts on Apple products

Job summary

Apple Inc. in Cupertino, California, is seeking a Machine Learning Engineer to build evaluation systems and scalable infrastructure for AI experiences across Apple products.

You will develop models, evaluators, and methodologies to measure and improve quality of LLMs and multimodal AI, working with ML researchers, software engineers, and product teams. You will translate research into production-ready solutions, analyze large-scale data, and push innovative benchmarking approaches to advance AI

Qualifications

• MS or PhD in CS, ML, EE, or related field, or equivalent practical experience.
• 1–2 years of industry or equivalent experience in ML/AI development.
• Proficiency in Python; familiarity with C++ or another OO language.
• Experience with PyTorch, TensorFlow, or JAX.
• Strong fundamentals in supervised learning, evaluation, and statistics.
• Experience with data processing, model training, or experimentation.

Responsibilities

• Design, develop, and deploy evaluation systems and scalable software.
• Build robust infrastructure to support model training, benchmarking, and large-scale evaluation.
• Analyze model performance and develop techniques to measure AI behavior.
• Collaborate with researchers, software engineers, and product teams to productionize research.
• Drive technical excellence through architecture, reviews, experiments, and best practices.

Skills

Python

PyTorch

TensorFlow

JAX

C++

Git

Data analysis

Model evaluation

Education

Master's degree in CS/ML/EE or related field

PhD in ML/AI (preferred)

Tools

CI/CD

GIT

Job description

Apple Inc. in Cupertino, California, is seeking a Machine Learning Engineer to build evaluation systems and scalable infrastructure for AI experiences across Apple products.

You will develop models, evaluators, and methodologies to measure and improve quality of LLMs and multimodal AI, working with ML researchers, software engineers, and product teams. You will translate research into production-ready solutions, analyze large-scale data, and push innovative benchmarking approaches to advance AI