Principal Scientist, Human‑AI Collaboration

Amazon; Austin (TX); On-site; USD 199,000 - 269,000; Full time

Job summary

Amazon’s Humorphic Labs is seeking a Principal Applied Scientist to drive the scientific agenda for human‑AI collaboration and to translate behavioral goals into end‑to‑end plans. You will author hypotheses, design evaluation tasks, and build significant portions of the experimental stack.

In this role, you will own the evaluation of teammate behavior, trust, adaptation, and recovery, while mentoring other scientists and engineers.

Qualifications

• PhD in computer science, machine learning, artificial intelligence, or a related technical field, or a Master's degree with equivalent applied science experience, or an equivalent body of work.
• Experience developing agentic AI systems or large language model applications through an end‑to‑end product cycle.
• Experience designing evaluation for systems that have no standard benchmark.
• Experience writing substantial research or production code in Python or a comparable language.
• Experience leading complex scientific work across engineering and product partners.
• Evidence of independent decisions in ambiguous, consequential technical environments.

Responsibilities

• Own the scientific strategy for human‑AI collaboration across agentic and multimodal systems.
• Convert desired interaction behaviors into falsifiable hypotheses, evaluation tasks, and system requirements.
• Build the evaluation system that measures teammate behavior, trust, adaptation, human contribution, and failure recovery.
• Design agent systems that use memory, tools, planning, and recovery, then test them with the people who do the work.
• Design data collection and curation for language, speech, and interaction traces.
• Build significant parts of the experimental stack yourself, because that stack does not exist yet.
• Diagnose failures across data, models, orchestration, evaluation, and product interaction.
• Define the requirements engineering needs to turn a proven method into a product capability.
• Partner with design, product, engineering, and behavioral research from problem definition through product validation.
• Run experiments with partner product teams, then report what worked, what failed, and what changed as a result.
• Set the standard for reproducible experiments, evidence, and scientific review inside the Lab.
• Mentor scientists and engineers without moving away from hands‑on work.
• Represent the work in internal reviews and in appropriate external scientific venues.

Skills

Python

Leadership

Research

Decision making

Agentic AI systems

Cross-functional collaboration

Education

PhD in computer science/ML/AI

Master's with equivalent applied science

Tools

Python

Job description

Amazon’s Humorphic Labs is seeking a Principal Applied Scientist to drive the scientific agenda for human‑AI collaboration and to translate behavioral goals into end‑to‑end plans. You will author hypotheses, design evaluation tasks, and build significant portions of the experimental stack.

In this role, you will own the evaluation of teammate behavior, trust, adaptation, and recovery, while mentoring other scientists and engineers.