Principal AI Scientist, Agentic WorkSpaces Leader

Amazon Web Services (AWS); New York (NY); On-site; USD 219,000 - 296,000; Full time

Job summary

Amazon Web Services, Inc. is seeking a Principal Applied Scientist to own the scientific vision across Agentic WorkSpaces, spanning Personal, Applications, and Core portfolios, including WS4Builders and WorkSpaces for Agents.

You will define how we measure, improve, and guarantee AI agents and human-AI teams performance, and set the science agenda for high-leverage research priorities at enterprise scale. You will collaborate across teams to shape models and agent frameworks, build benchmarks

Qualifications

• PhD in Computer Science, Machine Learning, or a related field, or a Master's with equivalent applied research experience
• 10+ years of applied science experience, including 8+ years applying ML to real-world products at scale
• Experience setting research direction and technical strategy across multiple teams and organizations
• Deep expertise in modern ML, including LLMs / foundation models, evaluation methodology, and experimental design
• Track record of delivering complex, ambiguous research initiatives from concept through production in enterprise environments

Responsibilities

• Set the long-term scientific vision for Agentic WorkSpaces and chart a multi-year research roadmap
• Solve highly ambiguous, novel problems in agent perception, reasoning, evaluation, reliability, and human-AI collaboration
• Own the evaluation and measurement foundation with benchmarks, datasets, and metrics
• Drive cross-organizational scientific alignment across partner teams and product portfolio
• Deliver measurable business impact through improved accuracy, cost and production time
• Raise the scientific bar with rigorous experimentation and reproducibility
• Advance the state of the art through publications, patents, and open-source contributions

Skills

Leadership

Experiment design

Evaluation methods

LLMs / foundation models

Cross-team collaboration

Reinforcement learning

Education

PhD in Computer Science

Tools

Benchmarks design

Metrics design

Job description

Amazon Web Services, Inc. is seeking a Principal Applied Scientist to own the scientific vision across Agentic WorkSpaces, spanning Personal, Applications, and Core portfolios, including WS4Builders and WorkSpaces for Agents.

You will define how we measure, improve, and guarantee AI agents and human-AI teams performance, and set the science agenda for high-leverage research priorities at enterprise scale. You will collaborate across teams to shape models and agent frameworks, build benchmarks