Machine Learning Evaluation Engineer

Apple, Inc.; Sunnyvale (CA); Sur place; USD 150 000 - 278 000; Plein temps

Avantages offerts par ce poste

Stock plan

Healthcare

Relocation

Tuition reimbursement

Discounted products

Résumé du poste

Apple, Inc. in Sunnyvale is seeking a highly motivated Machine Learning Evaluation Engineer to define evaluation strategies for computer vision and machine learning algorithms used in complex product experiences.

You will work with algorithm, data, and engineering teams to identify meaningful quality signals and develop robust evaluation frameworks. The role emphasizes failure analysis, scalable workflows, and reproducible metrics, with opportunities to leverage AI-assisted tools to accelerate

Qualifications

• BS in Computer Science, Electrical Engineering or related field required.
• 3+ years of ML/CV experience and evaluation expertise.
• Experience designing metrics for ML algorithms.
• Strong failure analysis and root-cause analysis skills.
• Experience with data quality, diversity, and coverage analysis.
• Proficient in Python for data processing, analysis, and visualization.
• Experience building automated evaluation pipelines and tooling.
• Ability to create clear visualizations and dashboards of model performance.

Responsabilités

• Define and drive evaluation strategy for CV/ML algorithms in product contexts.
• Design metrics and evaluation methodologies beyond accuracy.
• Analyze large datasets to identify data quality issues and coverage gaps.
• Investigate model failures and develop failure taxonomies.
• Build tools and visualizations to explore failures and root causes.
• Develop scalable, automated workflows for evaluation, analysis, and reporting.
• Leverage AI-assisted tools to accelerate data exploration and workflow automation.

Connaissances

Machine learning fundamentals

Computer vision

Python programming

Data analysis

Visualization

Formation

BS in Computer Science / related field

MS in CS/EE (preferred)

Outils

Python libraries (NumPy/Pandas)

ML eval frameworks

Data visualization tools

Description du poste

We are looking for a highly motivated Machine Learning Evaluation Engineer to join our team and help define and drive the evaluation of advanced machine learning and computer vision technologies. You will work closely with algorithm, data, and engineering teams to build scalable evaluation methodologies, uncover model weaknesses, and turn complex data into actionable insights. You will play a key role in ensuring that our ML systems deliver high-quality, robust experiences across diverse real-world scenarios. The ideal candidate combines strong fundamentals in classical machine learning and computer vision with hands‑on experience in metrics design, data analysis, failure analysis, visualization, and evaluation infrastructure. You should also be comfortable leveraging modern AI-assisted tools and workflows to improve engineering efficiency and accelerate analysis.

Description

In this role, you will define and drive the evaluation strategy for computer vision and machine learning algorithms used in complex product experiences. You will work closely with algorithm engineers to understand system behavior, identify the most meaningful quality signals, and develop evaluation frameworks that reflect real-world performance. You will design metrics and evaluation methodologies that go beyond aggregate accuracy and help the team understand performance across important data slices and scenarios. You will analyze large-scale datasets to identify gaps in data quality and coverage and develop strategies to improve the representativeness of training and evaluation data. A significant part of this role will involve failure analysis. You will investigate model failures, identify recurring patterns, develop failure taxonomies, and determine whether issues are driven by data, labeling, algorithm limitations, environmental conditions, or other system-level factors. You will build tools and visualizations that enable engineers to efficiently explore failures and understand the underlying root causes. You will also develop scalable and automated workflows for evaluation, analysis, and reporting. You will be expected to leverage modern AI-assisted tools where appropriate to accelerate data analysis, visualization development, coding, and workflow automation while maintaining technical rigor and reproducibility. As a member of the team, you will help shape evaluation best practices, influence algorithm and data decisions, and drive improvements across the ML development lifecycle. You should be comfortable navigating ambiguity, independently identifying opportunities for improvement, and partnering with cross-functional teams to deliver high-quality ML systems.

Minimum Qualifications

• BS and a minimum of 3 years relevant industry experience
• 3+ years of relevant industry experience in machine learning, computer vision, algorithm evaluation, data science, or a related field.
• Strong background in machine learning and computer vision, including classical ML and statistical modeling techniques.
• Proven experience designing and implementing evaluation methodologies and quality metrics for ML algorithms.
• Strong expertise in failure analysis and root-cause analysis, with the ability to identify systematic model weaknesses and translate findings into actionable recommendations.
• Experience analyzing data quality, diversity, representativeness, and coverage gaps across large and complex datasets.
• Strong programming skills in Python with experience in data processing, analysis, and visualization.
• Experience building automated and scalable evaluation pipelines and tooling.
• Ability to develop clear and insightful visualizations and dashboards that communicate model performance, regressions, and failure patterns.
• Strong understanding of statistical analysis, experimentation, and performance measurement.
• Ability to independently drive ambiguous technical problems from problem definition through analysis and recommendations.
• Experience using AI-powered development and analysis tools to improve productivity, accelerate data exploration, automate repetitive workflows, and improve engineering efficiency.

Preferred Qualifications

• MS in Computer Science, Computer Engineering, Electrical Engineering, Statistics, Applied Mathematics, or a related technical field (Advanced degree is a plus)
• Experience evaluating computer vision algorithms such as object detection, classification, tracking, segmentation, pose estimation, or hand tracking.
• Experience with large-scale ML datasets and data pipelines.
• Experience developing internal tools or platforms for ML evaluation and analysis.
• Experience with deep learning frameworks and modern ML systems.
• Experience with synthetic data, data augmentation, or automated data generation.
• Familiarity with model monitoring, regression detection, and production ML quality systems.
• Experience applying generative AI or AI-assisted workflows to engineering and analytical tasks.
• Experience mentoring engineers or providing technical leadership for complex evaluation initiatives.
• Excellent communication skills and the ability to collaborate effectively across algorithm, engineering, data, and product teams.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $150,400 and $277,600, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become an Apple shareholder through participation in Apple’s discretionary employee stock programs. Apple employees are eligible for discretionary restricted stock unit awards, and can purchase Apple stock at a discount if voluntarily participating in Apple’s Employee Stock Purchase Plan. You’ll also receive benefits including: Comprehensive medical and dental coverage, retirement benefits, a range of discounted products and free services, and for formal education related to advancing your career at Apple, reimbursement for certain educational expenses — including tuition. Additionally, this role might be eligible for discretionary bonuses or commission payments as well as relocation.

Note: Apple benefit, compensation and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal opportunity employer that is committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, Veteran status, or other legally protected characteristics. Learn more about your EEO rights as an applicant

At Apple, we believe accessibility is a fundamental human right. You’ll find that idea reflected in everything here — in our culture, our benefits and our digital tools. By welcoming as many perspectives as possible, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace

Learn about reasonable accommodations for job applicants