Senior Scientist: Human-AI Collaboration & Experiments

Amazon Web Services (AWS); Austin (TX); On-site; USD 199,000 - 269,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon Development Center U.S., Inc. is seeking a researcher to own the scientific agenda for Humorphic Labs’ AI teammate systems.

You will convert fuzzy behavioral goals into end-to-end plans, write code weekly, and build large portions of the experimental stack yourself. You will collaborate with product and engineering, initially hands‑on, then moving into a product team to drive adoption of lab‑proved capabilities.

Qualifications

• PhD in computer science, ML, AI or related field, or Master’s with applied research.
• Experience developing agentic AI systems or LLM applications end-to-end.
• Experience designing evaluation for systems without standard benchmarks.
• Substantial research or production Python code.
• Experience leading complex scientific work across engineering and product partners.
• Evidence of independent decisions in ambiguous, consequential technical environments.

Responsibilities

• Own the scientific strategy for human‑AI collaboration across agentic and multimodal systems.
• Convert desired interaction behaviors into falsifiable hypotheses, evaluation tasks, and system requirements.
• Build the evaluation system that measures teammate behavior, trust, adaptation, human contribution, and failure recovery.
• Design agent systems that use memory, tools, planning, and recovery, then test them with the people who do the work.
• Design data collection and curation for language, speech, and interaction traces.
• Build significant parts of the experimental stack yourself, because that stack does not exist yet.
• Diagnose failures across data, models, orchestration, evaluation, and product interaction.
• Define the requirements engineering needs to turn a proven method into a product capability.
• Partner with design, product, engineering, and behavioral research from problem definition through product validation.
• Run experiments with partner product teams, then report what worked, what failed, and what changed as a result.
• Set the standard for reproducible experiments, evidence, and scientific review inside the Lab.
• Mentor scientists and engineers without moving away from hands‑on work.
• Represent the work in internal reviews and in appropriate external scientific venues.

Skills

Agentic AI systems

End-to-end product cycle

Evaluation design

Python

Independent decision making

Cross-functional leadership

Education

PhD in computer science or related field

Master’s degree with applied science experience or equivalent

Job description

Amazon Development Center U.S., Inc. is seeking a researcher to own the scientific agenda for Humorphic Labs’ AI teammate systems.

You will convert fuzzy behavioral goals into end-to-end plans, write code weekly, and build large portions of the experimental stack yourself. You will collaborate with product and engineering, initially hands‑on, then moving into a product team to drive adoption of lab‑proved capabilities.