ML Evaluation Engineer - Vision & Multimodal Benchmarks

Apple Inc.; Sunnyvale (CA); Híbrido; USD 150.000 - 278.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical & Dental coverage

Employee stock programs

Relocation support

Education reimbursement

Descripción de la vacante

Apple Inc. is seeking a Machine Learning Evaluation Engineer to design and deploy evaluation strategies for multi-modal foundation models and CV/ML algorithms.

You will build scalable evaluation pipelines, perform comprehensive failure analyses, and collaborate with hardware, software, design, and core model training teams to drive product quality. The role emphasizes data curation, metric design, automation, and leveraging GenAI tools to accelerate analysis while maintaining rigorous scientific

Formación

• BS and a minimum of 3 years relevant industry experience.
• 3+ years of applied experience in Machine Learning, Computer Vision, or AI System Evaluation.
• Deep understanding of core ML principles including probability, statistics, data distributions, and model bias/variance.
• Experience analyzing data quality, diversity, representativeness, and coverage gaps in large datasets.
• Applied experience employing and evaluating generative models, including prompt tuning and human-in-the-loop methodologies.
• Proven track record of defining robust metrics and designing evaluation frameworks for foundation models.

Responsabilidades

• Benchmark state-of-the-art multi-modal models and develop evaluation pipelines.
• Design and implement end-to-end and component-level evaluation for text, image, and video tasks.
• Perform deep failure analysis to identify root causes in models, prompts, or downstream components.
• Create cloud-based, LLM-powered workflows and dashboards for failure analysis and reporting.
• Curate high-quality datasets and ground truth, including auto-labeling and synthetic data generation.
• Collaborate with cross-functional teams to provide actionable data-driven insights for model improvement.

Conocimientos

ML Evaluation

Python

CV/ML fundamentals

Educación

BS + 3 years experience

Herramientas

Cloud platforms

Descripción del empleo

Apple Inc. is seeking a Machine Learning Evaluation Engineer to design and deploy evaluation strategies for multi-modal foundation models and CV/ML algorithms.

You will build scalable evaluation pipelines, perform comprehensive failure analyses, and collaborate with hardware, software, design, and core model training teams to drive product quality. The role emphasizes data curation, metric design, automation, and leveraging GenAI tools to accelerate analysis while maintaining rigorous scientific