Principal ML Scientist, Agentic AI Systems Lead

11105 Expedia, Inc.; Seattle (WA); On-site; USD 224,000 - 314,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

Paid time off

Employee Assistance Program

Wellness/travel reimbursement

Travel discounts

IATAN membership

Job summary

Expedia Group is seeking a senior AI systems engineer to design and deploy multi-step agentic AI systems, integrating LLMs with external tools and data sources. You will work with product, engineering, and research teams to translate business requirements into scalable solutions.

You will mentor senior ML engineers, stay updated on cutting-edge agent architectures, and help define evaluation frameworks for reliability, cost, and safety in real-world deployments.

Qualifications

• BS in Computer Science, Machine Learning, Statistics, Engineering, or a related field; or equivalent professional experience.
• 10+ years of related industry experience.
• Demonstrated experience designing and deploying agentic or multi-step AI systems in production or research settings.
• Strong proficiency in Python and ML frameworks (PyTorch, TensorFlow, or JAX); experience with LLM APIs and orchestration libraries (e.g., LangChain, LlamaIndex, or similar).
• Experience integrating LLMs with external tools, APIs, and structured data sources for real-world task completion.
• Solid understanding of prompt engineering techniques including chain-of-thought, few-shot prompting, and structured output generation.
• Experience defining and running evaluation frameworks for ML systems, including offline benchmarking and production monitoring.
• Experience taking models from prototype to production in collaboration with Machine Learning Engineering teams.

Responsibilities

• Design, build, and evaluate multi-step agentic AI systems, including autonomous agents capable of planning, tool use, memory management, and multi-agent collaboration.
• Research and implement state-of-the-art techniques in agentic architectures (ReAct, reflection loops, chain-of-thought prompting).
• Develop and maintain agent orchestration frameworks with task decomposition and failure handling.
• Integrate LLMs with external tools, APIs, databases, and code execution environments for real-world task completion.
• Define and own evaluation frameworks for agentic systems across benchmarks and production scenarios.
• Lead collaboration with product, engineering, and research teams to translate requirements into designs and deliver production-grade solutions.
• Identify and mitigate risks for agentic systems (prompt injection, hallucination, unsafe tool use).
• Stay current with agentic AI developments and guide technical direction.
• Mentor senior ML engineers and scientists on design patterns and experimentation methodology.

Skills

Python

PyTorch

TensorFlow

JAX

LLM APIs

LangChain

LlamaIndex

Orchestration libraries

Prompt engineering

Production deployment

Education

BS in CS/ML/Engineering

PhD/MS preferred

Tools

LangChain

LlamaIndex

APIs integration

Job description

Expedia Group is seeking a senior AI systems engineer to design and deploy multi-step agentic AI systems, integrating LLMs with external tools and data sources. You will work with product, engineering, and research teams to translate business requirements into scalable solutions.

You will mentor senior ML engineers, stay updated on cutting-edge agent architectures, and help define evaluation frameworks for reliability, cost, and safety in real-world deployments.