ML Model Quality & GenAI Observability Engineer (NY Onsite)

Apple, Inc.; New York (NY); Presencial; USD 185 000 - 325 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Medical and dental coverage

Retirement benefits

Employee stock plan

Discounted products and services

Educational expense reimbursement

Resumo da oferta

Apple, Inc. seeks a data-centric ML engineer to strengthen data and model quality across Wallet, Payments, and Commerce experiences. You will build validation frameworks, synthetic data models, and monitoring pipelines to safeguard data from training to deployment.

You will own observability metrics and telemetry analysis for traditional ML as well as GenAI workflows, collaborating with Data Engineering, Privacy, and Legal teams to ensure robust, compliant systems.

Qualificações

• Bachelor's degree plus hands-on ML/AI model quality or applied research experience, or MS/PhD in ML/CS/DS/Statistics/Math/Engineering (strongly preferred)
• 3+ years defining and tracking ML model health metrics in production, including model performance monitoring, feature drift detection, and observability instrumentation
• 3+ years in ML, data science, or related analytical role focused on data quality, model evaluation, or ML observability in production
• Proficiency in Python with Pandas, NumPy, Scikit-learn, plus SQL for complex data analysis, metrics creation and validation
• Experience with large-scale data using PySpark, Spark, or distributed SQL
• Strong understanding of statistics (hypothesis testing, distribution analysis, data drift, SPC)
• Experience with GenAI/LLM systems, QA and telemetry instrumentation
• Strong communication skills to translate risks into actionable insights

Responsabilidades

• Build and maintain validation frameworks, synthetic data generation models, and monitoring pipelines to keep data ecosystem healthy from training through deployment
• Own end-to-end data ecosystem health by defining observability metrics and driving telemetry analysis for conventional ML and GenAI workflows
• Collaborate with Data Engineering, Privacy, and Legal teams
• Define, implement, and analyze observability metrics for ML system quality and reliability
• Build models to calibrate and measure robustness
• Lead telemetry analysis across GenAI workflows

Conhecimentos

ML model health metrics

Observability

Telemetry analysis

Python

Pandas

NumPy

Scikit-learn

SQL

PySpark

Spark

GenAI / LLM

Data visualization

Formação académica

Bachelor's degree

MS or PhD in ML / CS / Data Science

Ferramentas

Python

Pandas

NumPy

Scikit-learn

SQL

PySpark

Spark

Tableau

Apache Superset

Databricks

LangSmith

MLflow

Weights & Biases

Descrição da oferta de emprego

Apple, Inc. seeks a data-centric ML engineer to strengthen data and model quality across Wallet, Payments, and Commerce experiences. You will build validation frameworks, synthetic data models, and monitoring pipelines to safeguard data from training to deployment.

You will own observability metrics and telemetry analysis for traditional ML as well as GenAI workflows, collaborating with Data Engineering, Privacy, and Legal teams to ensure robust, compliant systems.