ML Model Quality Engineer – GenAI & Production Data

Apple, Inc.; San Diego (CA); On-site; USD 175,000 - 309,000; Full time

Benefits offered by this job

Medical & dental

Retirement benefits

Employee stock programs

Tuition reimbursement

Bonuses or commissions

Relocation

Job summary

Apple, Inc. seeks a Machine Learning Engineer, AI/ML Model Quality, to own data health for ML and GenAI across Wallet, Payments, and Commerce.

Build validation frameworks, observability metrics, and telemetry to ensure models are trained, evaluated, and deployed on trusted data for hundreds of millions of users. You will work with Data Engineering, Privacy, and Legal teams to calibrate and measure robustness, monitor data quality, and translate signals into actions for engineering and product

Qualifications

• Bachelor's degree or higher in a quantitative field or equivalent hands-on experience.
• 3+ years of production ML health metrics, monitoring, and observability.
• 3+ years in ML/data science roles focusing on data quality, model evaluation, or observability.
• Proficiency in Python (Pandas, NumPy, Scikit-learn) and SQL for data analysis.
• Experience with distributed computing (PySpark/Spark).
• Solid understanding of statistics, data drift, hypothesis testing, and CSP.
• Experience with GenAI/LLM systems and telemetry instrumentation.
• Strong communication to translate data findings to engineers and stakeholders.

Responsibilities

• Curate gold-standard ground-truth data for model evaluation and validation.
• Audit training data for bias and data drift with analytical checks.
• Define telemetry across GenAI workflows and monitor quality signals.
• Detect model degradation in production with privacy-preserving methods.
• Define and own data quality observability metrics and dashboards.
• Develop real-time dashboards and reporting for stakeholders.

Skills

Python

Pandas

NumPy

Scikit-learn

PyTorch

SQL

PySpark

Spark

Education

Bachelor's degree

MS/PhD in ML or related

Tools

Tableau

Databricks

Superset

LangSmith

MLflow

Weights & Biases

Spark

PySpark

Job description

Apple, Inc. seeks a Machine Learning Engineer, AI/ML Model Quality, to own data health for ML and GenAI across Wallet, Payments, and Commerce.

Build validation frameworks, observability metrics, and telemetry to ensure models are trained, evaluated, and deployed on trusted data for hundreds of millions of users. You will work with Data Engineering, Privacy, and Legal teams to calibrate and measure robustness, monitor data quality, and translate signals into actions for engineering and product