Principal Data Intelligence Platform Architect

Yahoo Holdings Inc.; Baltimore (MD); Hybrid; USD 144,000 - 299,000; Full time

Job summary

Yahoo Holdings Inc. is seeking a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms at Yahoo scale.

You will define technical direction, build reusable capabilities, and shape how engineers leverage AI to accelerate development while ensuring correctness, reliability, and security. Join a role that sits at the intersection of distributed data, enterprise knowledge, and agentic AI, with hybrid work options and a focus on scalable,

Qualifications

• 10+ years building distributed systems and large-scale data platforms.
• Degree in CS, AI/ML, Engineering, Math, or related field.
• Deep Python expertise and strong software engineering
• Production experience with batch and streaming processing (Kafka, or equivalent).
• Shipped and operated RAG applications in production; search, and reranking.
• Track record evaluating and validating AI-generated code correctness and operational safety.
• Strong communication and technical leadership across cross-functional stakeholders.

Responsibilities

• Define technical vision and architecture for Yahoo's AI-powered data intelligence platform.
• Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
• Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.
• Establish evaluation frameworks for retrieval quality, agent accuracy, and safety with automated benchmarking.
• Use AI development tools to accelerate design and validate AI-generated code and agent plans.
• Drive adoption of RAG and agentic patterns across engineers.
• Partner with product, governance, infrastructure, and priorities.

Skills

Distributed systems

Python

Communication

Leadership

Education

CS/AI/Engineering/Math degree

Tools

Kafka

Beam

Dataflow

Spark

Job description

Yahoo Holdings Inc. is seeking a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms at Yahoo scale.

You will define technical direction, build reusable capabilities, and shape how engineers leverage AI to accelerate development while ensuring correctness, reliability, and security. Join a role that sits at the intersection of distributed data, enterprise knowledge, and agentic AI, with hybrid work options and a focus on scalable,