Applied Scientist - Simulation and Large-Scale RL, Amazon Robotics - Vulcan Stow

Amazon Inc.

Seattle (WA)

On-site

USD 180,000 - 230,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Health insurance
401(k) matching
Paid time off
RSU eligibility

Job summary

Amazon Robotics in Seattle seeks an Applied Scientist to advance reinforcement learning for manipulation. You will train policies in simulation at scale and transfer them to real robots, contributing to designs that handle diverse, contact-rich tasks with robustness and speed.

You will build scalable training pipelines, develop sim-to-real methods, and collaborate across control, perception, and hardware to turn prototypes into deployed capabilities at scale.

Qualifications

  • PhD or Master’s degree with 4+ years in science, technology, engineering or related field.
  • Strong background in reinforcement learning, reward design, and scalable training.
  • Experience training RL or imitation learning for robotic manipulation or control problems.

Responsibilities

  • Design and train reinforcement learning policies for non-prehensile and contact-rich manipulation.
  • Build and scale simulation environments and training curricula.
  • Develop sim-to-real methods and validate them on physical hardware.
  • Write production-quality code and own scalable training/evaluation pipelines.
  • Evaluate policy behavior and iterate between simulation and real-world testing to improve robustness.
  • Collaborate with control, perception, and hardware teams to move ideas from prototype to deployment.
  • Represent Amazon Robotics in academia through publications and presentations.

Skills

Reinforcement learning
Deep learning
Robot manipulation

Education

PhD or Master’s in STEM

Tools

Python
C++
Java

Job description

Our organization in Amazon Robotics builds robots that perform contact-rich manipulation safely and reliably in complex, unstructured environments at Amazon scale. Our scientists and engineers push the boundaries of robotic manipulation to handle unparalleled object diversity, bringing deep expertise across planning, control, perception, and machine learning. We learn from real-world data at a scale that few teams in robotics can access.

We are seeking an Applied Scientist to advance reinforcement learning for manipulation. We are creating robots that learn how to push, flip, rearrange, and dexterously insert items with unparalleled robustness, speed, and reliability. Our goal is to deploy robots that will work across Amazon's global network and can handle the full diversity of items that Amazon sells. You will focus on training these policies in simulation at scale and transferring them to physical robots. You will join a small team whose mission reaches beyond any single product: to invent and apply manipulation capabilities that generalize to many future robotics applications. The robots our organization already deploys at scale give you a rare proving ground to collect data, run experiments, and get new policies onto real hardware faster than almost anywhere in the field.

Key job responsibilities
  • Design and train reinforcement learning policies for non-prehensile and contact-rich manipulation, focused on the long tail of diverse, demanding conditions.
  • Build and scale simulation environments, training curricula, and reward formulations that produce policies which transfer to real robots.
  • Develop sim-to-real methods (domain randomization, system identification, and related techniques) and validate them on physical hardware.
  • Write production-quality code and own scalable, efficient training and evaluation pipelines.
  • Evaluate policy behavior and failure modes, and iterate between simulation and real-world testing to improve robustness.
  • Partner with scientists and engineers across control, perception, and hardware to move ideas from prototype to demonstrated capability.
  • Represent Amazon Robotics in academia through publications and scientific presentations.
A day in the life

Amazon offers a full range of benefits that assist you and eligible family members, including domestic partners. Benefits can vary by location, the number of regularly scheduled hours you work, length of employment, and job status such as seasonal or temporary employment. The benefits that generally apply to regular, full-time employees include:

  • 1. Medical, Dental, and Vision Coverage
  • 2. Maternity and Parental Leave Options
  • 3. Paid Time Off (PTO)
  • 4. 401(k) Plan

If you are not sure that every qualification on the list above describes you exactly, we'd still love to hear from you! At Amazon, we value people with unique backgrounds, experiences, and skillsets. If you're passionate about this role and want to make an impact on a global scale, please apply!

Basic Qualifications:
  • PhD, or Master's degree and 4+ years of science, technology, engineering or related field experience
  • Experience programming in Java, C++, Python or related language
  • Experience in patents or publications at top-tier peer-reviewed conferences or journals
  • Experience training reinforcement learning or imitation learning policies for manipulation or robot control problems
  • Strong background in reinforcement learning, including reward design and training at scale in simulation
Preferred Qualifications:
  • Experience in professional software development
  • Experience with sim-to-real transfer (domain randomization, system identification, etc.), including transferring learned policies onto physical robots.
  • Familiarity with learned dynamics or world models for manipulation
Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, a
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Applied Scientist - Manipulation RL, Amazon Robotics - Vulcan Stow
Senior Applied Scientist - Manipulation RL, Amazon Robotics - Vulcan Stow

Amazon Inc. • Seattle (WA)

Hybrid
USD 167,000 - 226,000
Applied Scientist - Amazon Robotics, Amazon Robotics - Vulcan Stow
Applied Scientist - Amazon Robotics, Amazon Robotics - Vulcan Stow

Amazon Inc. • Memphis (TN)

On-site
USD 143,000 - 193,000
Applied Scientist - Amazon Robotics, Amazon Robotics - Vulcan Stow
Applied Scientist - Amazon Robotics, Amazon Robotics - Vulcan Stow

Amazon Inc. • Seattle (WA)

Hybrid
USD 143,000 - 193,000
Medical Insurance
Dental Insurance
Vision Insurance
+3
Applied Scientist II - Robotics Simulation, Amazon Robotics R&D
Applied Scientist II - Robotics Simulation, Amazon Robotics R&D

Amazon Inc. • Town of Westboro (WI)

On-site
USD 143,000 - 193,000
Applied Scientist II, Reinforcement Learning
Applied Scientist II, Reinforcement Learning

Amazon Inc. • North Reading (MA)

On-site
USD 143,000 - 193,000
Health insurance
RSUs
Sign-on payments
+2
Applied Scientist II, Reinforcement Learning
Applied Scientist II, Reinforcement Learning

Amazon Inc. • Massachusetts

On-site
USD 143,000 - 193,000
Sign-on payments & RSUs
Health insurance
401(k) matching
+2
Applied Scientist, Mobile Manipulation Robotics (I/O)
Applied Scientist, Mobile Manipulation Robotics (I/O)

Amazon Inc. • North Reading (MA)

On-site
USD 150,000 - 210,000
Health insurance
RSUs
Senior Robotics SDE III, Amazon Robotics - Vulcan
Senior Robotics SDE III, Amazon Robotics - Vulcan

Amazon Inc. • Seattle (WA)

On-site
USD 168,000 - 227,000
Research Scientist, Mobile Manipulation Robotics (I/O)
Research Scientist, Mobile Manipulation Robotics (I/O)

Amazon Inc. • North Reading (MA)

On-site
USD 159,000 - 215,000
RSUs
Sign-on bonus
Health insurance
+1
Senior Applied Scientist, Robotics Simulation
Senior Applied Scientist, Robotics Simulation

Amazon Inc. • Seattle (WA)

Hybrid
USD 167,000 - 226,000