Lead Scientist, Human-AI Collaboration Lab

Amazon; Sunnyvale (CA); On-site; USD 199,000 - 269,000; Full time

Job summary

Amazon AWS Applied AI Solutions is seeking a leader to own the scientific agenda for human-AI collaboration in agentic and multimodal systems. You will convert behavioral goals into falsifiable hypotheses, build an evaluation stack, and design data collection for language, speech, and interaction traces.

You will write production-grade code weekly, mentor scientists, and partner with design, product, and engineering teams from problem definition through validation.

Qualifications

• PhD in computer science or related field, or Master’s with equivalent experience.
• Experience developing agentic AI systems or large language model applications through an end-to-end product cycle
• Experience designing evaluation for systems that have no standard benchmark
• Experience writing substantial research or production code in Python or a comparable language
• Experience leading complex scientific work across engineering and product partners
• Evidence of independent decisions in ambiguous, consequential technical environments
• Experience with post-training methods including supervised fine-tuning and reinforcement learning
• Experience with multimodal models across language, speech, and vision
• Experience with speech systems or real-time conversational systems
• Experience measuring collaboration quality, trust, adaptation, or human contribution in AI systems
• Experience building agent systems that use memory, tools, planning, and recovery mechanisms
• Experience founding a scientific program, or joining an early team before that team had established its methods
• A record of scientific influence through publications, patents, open-source work, or deployed systems
• Experience mentoring senior scientists and engineers without moving away from hands-on work
• Experience partnering with design, product, and behavioral research from problem definition through product validation
• Experience taking a proven method into a product team and staying until that team adopted it

Responsibilities

• Own the scientific strategy for human-AI collaboration across agentic and multimodal systems.
• Convert desired interaction behaviors into falsifiable hypotheses evaluation tasks and system requirements.
• Build the evaluation system that measures teammate behavior trust adaptation human contribution and failure recovery.
• Design agent systems that use memory tools planning and recovery then test them with the people who do the work.
• Design data collection and curation for language speech and interaction traces.
• Build significant parts of the experimental stack yourself because that stack does not exist yet.
• Diagnose failures across data models orchestration evaluation and product interaction.
• Define the requirements engineering needs to turn a proven method into a product capability.
• Partner with design product engineering and behavioral research from problem definition through product validation.
• Run experiments with partner product teams then report what worked what failed and what changed as a result.
• Set the standard for reproducible experiments evidence and scientific review inside the Lab.
• Mentor scientists and engineers without moving away from hands-on work.
• Represent the work in internal reviews and in appropriate external scientific venues.

Skills

Agentic AI systems

End-to-end product cycle

Scientific communication

Mentoring researchers

Independent decisions

Education

PhD in computer science or related field

Master’s degree with equivalent applied science experience

Tools

Python

Experiment design tools

Job description

Amazon AWS Applied AI Solutions is seeking a leader to own the scientific agenda for human-AI collaboration in agentic and multimodal systems. You will convert behavioral goals into falsifiable hypotheses, build an evaluation stack, and design data collection for language, speech, and interaction traces.

You will write production-grade code weekly, mentor scientists, and partner with design, product, and engineering teams from problem definition through validation.