Senior Applied Scientist, Human-AI Collaboration

Amazon Web Services (AWS); Austin (TX); On-site; USD 199,000 - 269,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Development Center U.S., Inc. in Austin, TX seeks an Applied Scientist to lead human-AI collaboration research. You will own the scientific agenda, convert behavioral goals into end-to-end experiments, and ship reusable evaluation systems with engineers and product teams.

You will design data collection for language, speech, and interaction traces, write substantial code in Python, and mentor other scientists while advancing product-facing capabilities.

Qualifications

• PhD in CS/ML/AI or Master’s with equivalent experience.
• Experience developing agentic AI systems or LLM applications end-to-end.
• Experience designing evaluation for systems without standard benchmarks.
• Experience writing substantial research/production code in Python.
• Experience leading complex scientific work across engineering and product.
• Evidence of independent decisions in ambiguous technical environments.

Responsibilities

• Own the scientific strategy for human-AI collaboration across agentic and multimodal systems.
• Convert desired interaction behaviors into falsifiable hypotheses, evaluation tasks, and system requirements.
• Build the evaluation system that measures teammate behavior, trust, adaptation, human contribution, and failure recovery.
• Design agent systems that use memory, tools, planning, and recovery, then test them with the people who do the work.
• Design data collection and curation for language, speech, and interaction traces.
• Build significant parts of the experimental stack yourself, because that stack does not exist yet.
• Diagnose failures across data, models, orchestration, evaluation, and product interaction.
• Partner with design, product, engineering, and behavioral research from problem definition through product validation.
• Run experiments with partner product teams, then report what worked, what failed, and what changed as a result.
• Set the standard for reproducible experiments, evidence, and scientific review inside the Lab.
• Mentor scientists and engineers without moving away from hands-on work.
• Represent the work in internal reviews and in appropriate external scientific venues.

Skills

Python programming

End-to-end product cycle

Agentic AI systems

Evaluation design

Leadership

Independent decision making

Education

PhD in CS/ML/AI or Master’s with equivalent

Equivalent body of work

Tools

Python

Job description

Amazon Development Center U.S., Inc. in Austin, TX seeks an Applied Scientist to lead human-AI collaboration research. You will own the scientific agenda, convert behavioral goals into end-to-end experiments, and ship reusable evaluation systems with engineers and product teams.

You will design data collection for language, speech, and interaction traces, write substantial code in Python, and mentor other scientists while advancing product-facing capabilities.