AI Data Intelligence Platform Architect

Yahoo Holdings Inc. in

New York (NY)

Hybrid

USD 144,000 - 299,000

Full time

3 days ago

Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Flexible hybrid work options

Job summary

Yahoo Holdings Inc. is seeking a Principal Engineer to lead architecture and development of AI-powered data intelligence platforms at Yahoo scale.

You will guide the integration of retrieval-augmented generation and multi-agent systems, shaping how teams leverage AI across the data ecosystem. You will establish technical direction, create reusable platform capabilities, and drive adoption across engineering, analytics, governance, and business units while ensuring correctness, reliability, and

Qualifications

10+ years building distributed systems and large-scale data platforms.
Degree in CS, AI/ML, Engineering, Math, or related field.
Deep Python expertise and strong software engineering.
Production experience with batch and streaming processing (Kafka).
Shipped and operated RAG applications in production; search and reranking.

Responsibilities

Define technical vision and architecture for Yahoo's AI-powered data intelligence platform.
Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.
Establish evaluation frameworks - retrieval quality, agent accuracy, hallucination rate, operational safety - with automated benchmarking.
Use AI development tools to accelerate design and validate AI-generated code and agent plans.
Drive adoption of RAG and agentic patterns across engineers.
Partner with product, governance, infrastructure, and cross-functional priorities.