AI-Driven Data Intelligence Architect — Principal

Yahoo Holdings Inc. in; Omaha (NE); Hybrid; USD 144,000 - 299,000; Full time

Benefits offered by this job

Flexible hybrid work

Healthcare benefits

401k

Job summary

Yahoo Holdings Inc. is seeking a Principal Engineer to lead the architecture and development of AI-powered data intelligence platforms at scale.

You will work on large-scale distributed data systems, Retrieval-Augmented Generation, and agentic AI to help teams detect anomalies, diagnose incidents, and trust data. You will define technical direction, build reusable platform capabilities, ensure correctness and safety, and drive adoption of RAG patterns across engineering, governance, and business

Qualifications

• 10+ years building distributed systems and large-scale data platforms.
• Degree in CS, AI/ML, Engineering, or related field.
• Deep Python expertise and strong software engineering skills.
• Production experience with batch and streaming processing.
• Shipped and operated RAG applications in production; strong AI safety focus.

Responsibilities

• Define technical vision and architecture for Yahoo's AI-powered data intelligence platform.
• Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
• Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.
• Establish evaluation frameworks for retrieval quality, agent accuracy, and operational safety.
• Use AI development tools to accelerate design and validate AI-generated code and agent plans.
• Drive adoption of RAG and agentic patterns across engineers.
• Partner with product, governance, infrastructure, and business priorities.

Skills

Distributed systems

Python

Technical leadership

Education

CS/AI/Engineering degree

Tools

Kafka

Beam/Dataflow

Spark

Job description

Yahoo Holdings Inc. is seeking a Principal Engineer to lead the architecture and development of AI-powered data intelligence platforms at scale.

You will work on large-scale distributed data systems, Retrieval-Augmented Generation, and agentic AI to help teams detect anomalies, diagnose incidents, and trust data. You will define technical direction, build reusable platform capabilities, ensure correctness and safety, and drive adoption of RAG patterns across engineering, governance, and business