Principal Engineer — AI-Powered Data Intelligence

Yahoo Holdings Inc.; Omaha (NE); Hybrid; USD 144,000 - 299,000; Full time

Benefits offered by this job

Healthcare

401k

Backup childcare

Education stipends

Job summary

Yahoo Holdings Inc. seeks a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms at Yahoo scale. You will shape how AI reasons over Yahoo's data ecosystem to help teams detect anomalies, diagnose incidents, and trust data for decision-making.

You will set technical direction, build reusable platform capabilities, and drive adoption of AI-assisted development and automation while upholding reliability, security, and operational safety.

Qualifications

• 10+ years building distributed systems and large-scale data platforms.
• Degree in CS, AI/ML, Engineering, Math, or related field.
• Deep Python expertise and strong software engineering skills.
• Production experience with batch and streaming processing (Kafka).
• Shipped and operated RAG applications in production; search and reranking.
• Strong communication and technical leadership across cross-functional stakeholders.

Responsibilities

• Define technical vision and architecture for Yahoo's AI-powered data intelligence platform.
• Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
• Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.
• Establish evaluation frameworks - retrieval quality, agent accuracy, hallucination rate, operational safety.
• Use AI development tools to accelerate design and validate AI-generated code and agent plans.
• Drive adoption of RAG and agentic patterns across engineers.
• Partner with product, governance, infrastructure, and business priorities.

Skills

Distributed systems

Python

Kafka

Leadership

AI/ML knowledge

Education

CS/AI/Engineering/Math degree

Tools

Beam

Dataflow

Spark

Kafka

Job description

Yahoo Holdings Inc. seeks a Principal Engineer (IC5) to lead the architecture and development of AI-powered data intelligence platforms at Yahoo scale. You will shape how AI reasons over Yahoo's data ecosystem to help teams detect anomalies, diagnose incidents, and trust data for decision-making.

You will set technical direction, build reusable platform capabilities, and drive adoption of AI-assisted development and automation while upholding reliability, security, and operational safety.