Hybrid Lead Data Intelligence & AI Platform Engineer

110 Yahoo Holdings Inc.

United States

Hybrid

USD 144,000 - 299,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Flexible hybrid work

Healthcare

401k

Education stipends

Job summary

Yahoo seeks a senior engineer to lead its AI-powered data intelligence platform. You will define the technical vision, architect petabyte-scale batch/streaming systems, and build RAG-based workflows with semantic metadata.

You’ll collaborate across product, governance, and infra teams to deliver trustworthy data capabilities. The role requires deep Python, distributed systems expertise, and leadership across cross-functional teams.

Qualifications

10+ years building distributed systems and large-scale data platforms.
Degree in CS, AI/ML, Engineering, Math, or related field.
Production experience with batch and streaming processing.
Experience shipping and operating RAG applications in production.

Responsibilities

Define technical vision and architecture for Yahoo's AI-powered data platform.
Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
Build production RAG and multi-agent systems with semantic metadata integration.
Establish evaluation frameworks for retrieval quality and safety with automated benchmarking.
Drive adoption of RAG and agentic patterns across engineers.