Senior AIML Evaluation & Optimization Lead

Apple Inc.; Cupertino (CA); Vor Ort; USD 238.000 - 402.000; Vollzeit

Benefits dieser Stelle

Stock options

Relocation assistance

Comprehensive medical/dental coverage

Employee stock purchase plan

Zusammenfassung

Apple Inc. in Cupertino, CA seeks a Senior Machine Learning Engineering Manager for AIML Evaluation. You will lead a tiny team, bridging research and production to improve evaluation loops for foundation models and agents, and drive data, prompts, tools, and reward signal enhancements.

You will mentor engineers, define the technical roadmap, and coordinate with product teams to deliver scalable evaluation workflows and synthetic data generation while ensuring privacy and reproducibility.

Qualifikationen

• 8+ years in machine learning, applied research, or software engineering with production ML experience.
• 3+ years in technical leadership including people management.
• Master’s or PhD in Computer Science, ML, AI, or related field.
• Strong Python skills and production ML pipeline experience.
• Deep experience with LLMs or agentic systems and evaluation.
• Experience building automated evaluation methods and benchmarks.
• Experience in one refinement area: prompts, context, post-training, or reward models.
• Excellent written and verbal communication to align teams.

Aufgaben

• Architect scalable evaluation systems for foundation models and agents.
• Lead a small team, shaping technical direction and mentoring engineers.
• Define strategy for automatic prompt/context/tool/agent-harness optimization.
• Develop methods turning evaluation findings into model-improvement signals.
• Scale synthetic data generation pipelines for evaluation and post-training.
• Translate research into production-quality workflows and collaborate with product teams.

Kenntnisse

ML/AI experience

Technical leadership

Advanced degree

Python & ML pipelines

LLM/agent evaluation

Automated evaluation methods

Model refinement

Communication skills

Ausbildung

Master's or PhD in CS/ML/AI

Tools

Python

ML frameworks

Jobbeschreibung

Apple Inc. in Cupertino, CA seeks a Senior Machine Learning Engineering Manager for AIML Evaluation. You will lead a tiny team, bridging research and production to improve evaluation loops for foundation models and agents, and drive data, prompts, tools, and reward signal enhancements.

You will mentor engineers, define the technical roadmap, and coordinate with product teams to deliver scalable evaluation workflows and synthetic data generation while ensuring privacy and reproducibility.