ML Evaluation Engineer - Adversarial Testing at Scale

Apple Inc.; San Diego (CA); On-site; USD 139,500 - 258,100; Full time

Benefits offered by this job

Comprehensive medical and dental coverage

Retirement benefits

Employee stock programs

Educational reimbursement

Job summary

Apple Inc. is seeking an ML Engineer in San Diego, California to focus on building and scaling automated evaluation systems for AI features. The ideal candidate will possess a Bachelor's degree in Computer Science and over 4 years of experience in ML evaluation systems. Responsibilities include designing adversarial test suites and ensuring alignment between automated and human evaluation methods. Competitive compensation ranges from $139,500 to $258,100, with additional benefits including stock options and educational reimbursement.

Qualifications

• 4+ years of experience building or extending ML evaluation systems.
• Experience defining evaluation methodology for AI or ML systems.
• Independent experience with adversarial testing methodologies.

Responsibilities

• Define and own automated evaluation approach for AI features.
• Build adversarial test suites targeting model failure modes.
• Collaborate with engineering to integrate evaluation into workflows.

Skills

Building ML evaluation systems

Defining evaluation architecture

Adversarial testing methodologies

Experience with Python

Experience with ML frameworks

Education

Bachelor’s degree in Computer Science or related field

Tools

PyTorch

TensorFlow

Job description

Apple Inc. is seeking an ML Engineer in San Diego, California to focus on building and scaling automated evaluation systems for AI features. The ideal candidate will possess a Bachelor's degree in Computer Science and over 4 years of experience in ML evaluation systems. Responsibilities include designing adversarial test suites and ensuring alignment between automated and human evaluation methods. Competitive compensation ranges from $139,500 to $258,100, with additional benefits including stock options and educational reimbursement.