Applied Scientist - Agentic AI, Amazon Fulfillment Technology

Amazon Inc.

Bellevue (WA)

On-site

USD 143,000 - 193,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Amazon Fulfillment Technologies (AFT) seeks an Applied Scientist to lead the development of agentic systems for operational decision making and orchestration within Amazon's fulfillment network.

You will train LLMs with rejection sampling, SFT, continual post-training, and RL, while evaluating offline and online metrics and collaborating across teams on research publications.

Qualifications

  • 3+ years of building models for business applications.
  • PhD or Master’s degree with 4+ years of CS/CE/ML-related experience.
  • Experience programming in Java, C++, Python or related language.

Responsibilities

  • Generating training and preference data for use cases (reasoning trajectories, tool traces).
  • Reward modeling and policy optimization for LLMs: DPO, IPO, RLHF/RLAIF with PPO/GRPO, rejection sampling.
  • Supervised fine-tuning on step-by-step trajectories and tool-use traces.
  • Verbal Reinforcement Learning and Continual Learning.
  • RL for LLMs, Offline RL and off-policy evaluation.
  • Agentic memory/state management; episodic and semantic memory; vector search; grounding with RAG.
  • Evaluation: developing decision quality metrics, scaling LLM-based evaluations.

Skills

Java
Python
C++
Algorithms
Data mining
Parallel computing
Unix/Linux

Education

PhD
Master’s in CS/CE/ML

Tools

Unix/Linux

Job description

As an Applied Scientist in Amazon Fullfilment Technology, you will lead the development of agentic systems to assist with operational decision making and orchestration. You will work building full agentic systems leveraging multi-agent orchestration, tool use, memory, and action execution. You will train LLMs using a combination of rejection sampling approaches, SFT, continual post-training, and Reinforcement Learning (RL).

These systems are deployed to Amazon buildings, and you will also work on rigorous offline and online evaluations.

Your work will leverage the latest LLMs to develop capabilities for agentic reasoning, coding and analytics. You will also lead research projects to tackle unsolved problems, mentor interns, and author academic papers to summarize your findings for external publication.

Key job responsibilities
  • Generating training and preference data for specific use cases (reasoning trajectories, tool traces)
  • Reward modeling and policy optimization for LLMs: DPO, IPO, RLHF/RLAIF with PPO/GRPO, rejection sampling
  • Supervised fine-tuning on step-by-step trajectories and tool-use traces
  • Verbal Reinforcement Learning and Continual Learning
  • RL for LLMs, Offline RL and off-policy evaluation
  • Agentic memory/state management; episodic and semantic memory; vector search; grounding with RAG
  • Evaluation: developing decision quality metrics, scaling LLM-based evaluations
About the team

Amazon Fulfillment Technologies (AFT) powers Amazon's global fulfillment network. We invent and deliver software, hardware, and data science solutions that orchestrate processes, robots, machines, and people. We harmonize the physical and virtual world so Amazon customers can get what they want, when they want it. Learn more about AFT: https://tinyurl.com/AFTOverview

Basic Qualifications:
  • 3+ years of building models for business application experience
  • PhD, or Master's degree and 4+ years of CS, CE, ML or related field experience
  • Experience programming in Java, C++, Python or related language
  • Experience in any of the following areas: algorithms and data structures, parsing, numerical optimization, data mining, parallel and distributed computing, high-performance computing
Preferred Qualifications:
  • Experience using Unix/Linux
  • Experience in professional software development

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits .

USA, WA, Bellevue - 142,800.00 - 193,200.00 USD annually

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Applied Scientist - Agentic AI, Amazon Fulfillment Technology
Applied Scientist - Agentic AI, Amazon Fulfillment Technology

Amazon.com • Factoria (WA)

On-site
USD 143,000 - 193,000
Health insurance
401(k) matching
Paid time off
+1
Applied Scientist - Agentic AI, Amazon Fulfillment Technology
Applied Scientist - Agentic AI, Amazon Fulfillment Technology

Amazon Inc. • Bellevue (WA)

On-site
USD 143,000 - 193,000
Health insurance
401(k) matching
Paid time off
+2
Applied Scientist - Agentic AI, Amazon Fulfillment Technology
Applied Scientist - Agentic AI, Amazon Fulfillment Technology

Amazon Inc. • Cincinnati (OH)

On-site
USD 143,000 - 193,000
Health insurance
RSUs
401(k) matching
+1
Applied Scientist-LLM, Buy For Me
Applied Scientist-LLM, Buy For Me

Amazon Inc. • Seattle (WA)

On-site
USD 136,000 - 184,000
Health insurance
RSUs
401(k) matching
+2
Applied Scientist
Applied Scientist

Amazon Jobs • Palo Alto (CA)

On-site
USD 172,000 - 222,000
Health insurance
401(k) matching
Paid time off
+1
Applied Scientist
Applied Scientist

Amazon.com Inc. • Seattle (WA)

On-site
USD 143,000 - 193,000
Health insurance
401(k) matching
RSUs
+1
Software Dev Engineer II, Amazon Rufus
Software Dev Engineer II, Amazon Rufus

Amazon Inc. • Seattle (WA)

On-site
USD 144,000 - 194,000
Sr Scientist, Agentic AI, AWS Governance
Sr Scientist, Agentic AI, AWS Governance

Amazon Development Center U.S., Inc. • Seattle (WA)

On-site
USD 167,000 - 226,000
Health insurance
RSUs
401(k) matching
+2
Applied Scientist, Selling Partner Support Engagement
Applied Scientist, Selling Partner Support Engagement

Amazon Inc. • Seattle (WA)

On-site
USD 136,000 - 184,000
Health insurance
RSUs (restricted stock units)
Sign-on payment
+3
Applied Scientist II, AWS Quick
Applied Scientist II, AWS Quick

Amazon Development Center U.S., Inc. • New York (NY)

On-site
USD 172,000 - 223,000
Health insurance
401(k) matching
Paid time off
+1