Principal AI Data Intelligence Architect

Yahoo; Uz; Hybrid; EUR 124,000 - 258,000; Full time

Benefits offered by this job

Healthcare

401k

Backup childcare

Education stipends

Job summary

Yahoo is seeking a Principal Engineer (IC5) to lead architecture and development of AI-powered data intelligence platforms at Yahoo scale. You’ll define technical direction for enterprise AI systems and build reusable capabilities across engineering, analytics, governance, and business teams.

You will guide the adoption of RAG and agentic patterns, shape how AI is used to build software, and ensure correctness, reliability, security, and operational safety while enabling scalable AI development.

Qualifications

• 10+ years building distributed systems and large-scale data platforms.
• Degree in CS, AI/ML, Engineering, Math, or related field.
• Deep Python expertise and strong software engineering.
• Production experience with batch and streaming processing (Kafka, or equivalent).
• Shipped and operated RAG applications in production; search and reranking.
• Track record evaluating and validating AI-generated code correctness and operational safety.
• Strong communication and technical leadership across cross-functional stakeholders.

Responsibilities

• Define technical vision and architecture for Yahoo’s AI-powered data intelligence platform.
• Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
• Build production RAG and multi-agent systems: semantic metadata integration, agent orchestration.
• Establish evaluation frameworks — retrieval quality, agent accuracy, hallucination rate, operational safety — with automated benchmarking.
• Use AI development tools to accelerate design and set standards for validating AI-produced code and agent plans.
• Drive adoption of RAG and agentic patterns across engineers.
• Partner with product, governance, infrastructure, and strategic priorities.

Skills

Distributed systems

Python

RAG

AI safety

Leadership

Kafka

Streaming processing

Education

CS/AI/Engineering/Math degree

Tools

Beam

Dataflow

Spark

Kafka

Job description

Yahoo is seeking a Principal Engineer (IC5) to lead architecture and development of AI-powered data intelligence platforms at Yahoo scale. You’ll define technical direction for enterprise AI systems and build reusable capabilities across engineering, analytics, governance, and business teams.

You will guide the adoption of RAG and agentic patterns, shape how AI is used to build software, and ensure correctness, reliability, security, and operational safety while enabling scalable AI development.