Senior ML Engineer — AI-First, GenAI & Agentic Systems

Yahoo; United States; Hybrid; USD 128,000 - 267,000; Full time

Job summary

Yahoo Mail is seeking an experienced AI/ML engineer to design, deploy, and optimize high-throughput AI/ML capabilities for real-time personalization at scale. You will build production-grade LLM-backed applications and agentic workflows, orchestrate tool integrations, and advance AI-first engineering practices across a global team.

You will process petabyte-scale data, deploy fast inference models, and ensure resilience and cost efficiency while collaborating with architects, tech leads, and

Qualifications

• Bachelor's degree in Computer Science, Data Science, AI, or related field or equivalent experience.
• 5+ years of professional experience engineering and deploying production ML or data science systems at scale.
• Proficient in Python or Java with deep hands-on ML framework experience.
• Demonstrated experience building LLM-based applications or agentic systems.
• Experience deploying and serving models in production using vLLM, TensorRT-LLM, Triton, or ONNX Runtime.
• Hands-on experience processing large datasets using Spark, Hadoop, or cloud-native pipelines.

Responsibilities

• Architect and deploy high-throughput AI/ML capabilities powering real-time personalization for hundreds of millions of users.
• Lead GenAI and agentic systems implementation including prompt engineering and tool integration.
• Embed AI-first practices to accelerate development cycles and improve code quality.
• Process petabyte-scale data streams to derive insights from mail metadata and content.
• Deploy ML/LLM models for real-time production serving with modern frameworks.
• Design resilient systems with automated feedback loops and graceful failure handling.
• Balance compute costs, latency, quality, and model performance at massive scale.

Skills

Python

Java

PyTorch

TensorFlow

HuggingFace

Scikit-learn

GenAI & Agentic

High-Perf Inference

Big Data

Communication

Education

Bachelors in CS/AI

Tools

Spark

Hadoop

vLLM

TensorRT-LLM

Triton

ONNX Runtime

GCP

Job description

Yahoo Mail is seeking an experienced AI/ML engineer to design, deploy, and optimize high-throughput AI/ML capabilities for real-time personalization at scale. You will build production-grade LLM-backed applications and agentic workflows, orchestrate tool integrations, and advance AI-first engineering practices across a global team.

You will process petabyte-scale data, deploy fast inference models, and ensure resilience and cost efficiency while collaborating with architects, tech leads, and