Lead Applied Scientist: Human-AI Collaboration & Experiments

Amazon Web Services (AWS); New York (NY); On-site; USD 199,000 - 269,000; Full time

Benefits offered by this job

health insurance

401(k) matching

paid time off

parental leave

Job summary

Amazon Development Center U.S., Inc. is seeking an experienced contributor to lead the scientific agenda for human-AI collaboration. You will convert behavioral goals into end-to-end plans, build evaluation stacks, and write substantial production code in Python.

The role blends hands-on science with product integration and rapid iteration in a fast-moving environment. You will work closely with product and engineering to advance agentic AI systems, measuring memory, planning, and recovery

Qualifications

• PhD in computer science, machine learning, AI, or related field, or Master’s with equivalent applied science experience.
• Experience designing evaluation for AI systems lacking standard benchmarks.
• Experience writing substantial research or production code in Python or a comparable language.
• Experience leading complex scientific work across engineering and product partners.
• Experience developing agentic AI systems or large language model applications through an end-to-end product cycle.

Responsibilities

• Own the scientific strategy for human-AI collaboration across agentic and multimodal systems.
• Convert desired interaction behaviors into falsifiable hypotheses, evaluation tasks, and system requirements.
• Build the evaluation system that measures teammate behavior, trust, adaptation, human contribution, and failure recovery.
• Design agent systems that use memory, tools, planning, and recovery, then test them with the people who do the work.
• Design data collection and curation for language, speech, and interaction traces.
• Build significant parts of the experimental stack yourself, because that stack does not exist yet.

Skills

Python

Machine learning

Experiment design

Collaboration

Education

PhD in CS/ML or related

Tools

Python

PyTorch

TensorFlow

Job description

Amazon Development Center U.S., Inc. is seeking an experienced contributor to lead the scientific agenda for human-AI collaboration. You will convert behavioral goals into end-to-end plans, build evaluation stacks, and write substantial production code in Python.

The role blends hands-on science with product integration and rapid iteration in a fast-moving environment. You will work closely with product and engineering to advance agentic AI systems, measuring memory, planning, and recovery