Senior AI Data Intelligence Architect (Hybrid)

Yahoo; United States; Hybrid; USD 170,000 - 250,000; Full time

Benefits offered by this job

Flexible hybrid work options

Job summary

Yahoo seeks a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms at Yahoo scale. You will define technical direction, establish reference architectures, and build reusable platform capabilities across engineering, analytics, governance, and business teams.

You will shape how Yahoo engineers use AI to build software, leveraging AI-assisted development, evaluation, and automation to accelerate engineering while ensuring correctness,

Qualifications

• 10+ years building distributed systems and large-scale data platforms.
• Degree in CS, AI/ML, Engineering, Math, or related field.
• Deep Python expertise and strong software engineering fundamentals.
• Production experience with batch and streaming processing (Kafka or equivalent).
• Shipped and operated RAG applications in production; search, and reranking.
• Track record evaluating and validating AI-generated code correctness and operational safety.
• Strong communication and technical leadership across cross-functional stakeholders.

Responsibilities

• Define technical vision and architecture for Yahoo's AI-powered data intelligence platform.
• Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
• Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.
• Establish evaluation frameworks - retrieval quality, agent accuracy, hallucination rate, operational safety - with automated benchmarking, so we ship AI we can trust.
• Use AI development tools to accelerate design, implement the bar for how the org validates AI-generated code and agent plans.
• Drive adoption of RAG and agentic patterns across engineers.
• Partner with product, governance, infrastructure, and exit-form priorities.

Skills

Python

Software engineering

Leadership

Education

CS/AI/Engineering degree

Tools

Beam

Dataflow

Spark

Kafka

Job description

Yahoo seeks a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms at Yahoo scale. You will define technical direction, establish reference architectures, and build reusable platform capabilities across engineering, analytics, governance, and business teams.

You will shape how Yahoo engineers use AI to build software, leveraging AI-assisted development, evaluation, and automation to accelerate engineering while ensuring correctness,