Principal Data Intelligence Architect (Hybrid)

Yahoo Holdings Inc. in; Nashville (TN); Hybrid; USD 144,000 - 299,000; Full time

Benefits offered by this job

Hybrid work options

Healthcare benefits

Job summary

Yahoo is seeking a Principal Engineer to lead the architecture of AI-powered data intelligence platforms at scale. You will shape the direction of enterprise AI systems, enabling teams to discover trusted data, diagnose incidents, and automate complex workflows.

You will balance performance, correctness, and security while fostering cross-functional collaboration and scalable platform capabilities across engineering, governance, and business groups.

Qualifications

• 10+ years building distributed data platforms and systems.
• Degree in CS, AI/ML, Engineering, Math, or related field.
• Strong Python and software engineering fundamentals.

Responsibilities

• Define technical vision and architecture for Yahoo's AI-powered data intelligence platform.
• Architect petabyte-scale batch and streaming systems with Beam, Dataflow, Spark, and Kafka.
• Build production RAG and multi-agent systems for semantic metadata integration and orchestration.
• Establish evaluation frameworks for retrieval quality, agent accuracy, and safety.
• Accelerate AI-driven design and ensure correctness and security in deployments.
• Drive adoption of RAG and agentic patterns across teams.

Skills

Distributed systems

Python

Technical leadership

Cross-functional collaboration

Data engineering

Communication

System design

Education

CS/Engineering/AI/Math degree

Tools

Beam

Dataflow

Spark

Kafka

Vertex AI

BigQuery

Vector Search

Job description

Yahoo is seeking a Principal Engineer to lead the architecture of AI-powered data intelligence platforms at scale. You will shape the direction of enterprise AI systems, enabling teams to discover trusted data, diagnose incidents, and automate complex workflows.

You will balance performance, correctness, and security while fostering cross-functional collaboration and scalable platform capabilities across engineering, governance, and business groups.