Senior AI/ML Systems Engineer, Evaluation Platform

Apple, Inc.; Cupertino (CA); Sur place; USD 150 000 - 278 000; Plein temps

Avantages offerts par ce poste

Comprehensive medical and dental

Retirement benefits

Employee stock programs

Educational expense reimbursement

Relocation assistance

Résumé du poste

Apple, Inc. in Cupertino, California seeks a Sr Software Engineer - AI Evaluation to own a core evaluation platform end-to-end.

You will drive architecture, roadmap, reliability, and developer experience for multiple features, collaborating with teams building LLM judges and AI coding agents to ensure high quality releases. The role sits at the intersection of AI modeling, software engineering, and product quality, requiring a balance between scientific rigor and product delivery while

Qualifications

• 8+ years of software engineering experience, including owning production systems used by other teams.
• Exceptional Python skills and a strong engineering understanding of system design, API design, system testing and validation, debugging and monitoring.
• Experienced in shipping production code with AI coding agents while keeping quality high.

Responsabilités

• Own a core evaluation system end-to-end for multiple features: architecture, roadmap, reliability, and developer experience.
• Design testing and validation strategies that catch real failures before partners do.
• Build and maintain integrations with annotation, compute, reporting, and benchmarking platforms.
• Partner with teams building LLM judges on our platform, turning their recurring needs into product.
• Set the bar for using AI coding agents without compromising quality.
• Customer-oriented: treats internal users' needs as the job, never loses sight of Apple customers and product quality, and communicates clearly to align cross-functional partners.

Connaissances

Python

Software engineering

System design

API design

Testing & validation

Debugging & monitoring

Ownership of production systems

Formation

BS/MS/PhD in Computer Science, Machine Learning, or related field

Description du poste

Apple, Inc. in Cupertino, California seeks a Sr Software Engineer - AI Evaluation to own a core evaluation platform end-to-end.

You will drive architecture, roadmap, reliability, and developer experience for multiple features, collaborating with teams building LLM judges and AI coding agents to ensure high quality releases. The role sits at the intersection of AI modeling, software engineering, and product quality, requiring a balance between scientific rigor and product delivery while