Applied Scientist II, Reinforcement Learning

Amazon; Omaha, Northern (NE, KY); Hybrid; USD 143,000 - 193,000; Full time

Benefits offered by this job

Health insurance

401(k) matching

Paid time off

Parental leave

Job summary

Amazon is seeking exceptional talent to develop the next generation of advanced robotics systems that transform automation at scale. You will work on real-time controllers for dexterous manipulation and locomotion, integrating AI, control theory, and mechanical design.

The role involves mentoring engineers and collaborating with multi-disciplinary teams to co-design hardware and algorithms, advancing research from theory to practical deployment in robotic systems.

Qualifications

• PhD, or Master’s degree and 2+ years of CS, CE, ML or related field experience.
• Experience with imitation learning and reinforcement learning for whole-body control.
• Experience with methods such as hierarchical quadratic programming and model-predictive control.
• Experience with simulation environments such as IsaacLab, Mujoco, Drake, etc.
• Experience with developing and deploying code for real-time controllers.
• Experience in state estimation from multiple sensor modalities.

Responsibilities

• Design and implement whole body control methods for balance, locomotion, and dexterous manipulation.
• Utilize state-of-the-art methods in learned and model-based control.
• Create robust and safe behaviors for different terrains and tasks.
• Implement real-time controllers with stability guarantees.
• Collaborate effectively with multi-disciplinary teams to co-design hardware and algorithms for loco-manipulation.
• Mentor junior engineer and scientists.

Skills

Imitation learning

Reinforcement learning

State estimation

Real-time control

Education

PhD or Master’s + 2 years in CS/CE/ML

Tools

IsaacLab

MuJoCo

Drake

ROS

Job description

Job ID: 10534573 | Amazon.com Services LLC

Amazon is seeking exceptional talent to help develop the next generation of advanced robotics systems that will transform automation at Amazon's scale. We're building revolutionary robotic systems that combine cutting-edge AI, sophisticated control systems, and advanced mechanical design to create adaptable automation solutions capable of working safely alongside humans in dynamic environments. This is a unique opportunity to shape the future of robotics and automation at an unprecedented scale, working with world-class teams pushing the boundaries of what's possible in robotic dexterous manipulation, locomotion, and human-robot interaction. This role presents an opportunity to shape the future of robotics through innovative applications of deep learning and large language models.

At Amazon we leverage advanced robotics, machine learning, and artificial intelligence to solve complex operational challenges at an unprecedented scale. Our fleet of robots operates across hundreds of facilities worldwide, working in sophisticated coordination to fulfill our mission of customer excellence.

The ideal candidate will contribute to research that bridges the gap between theoretical advancement and practical implementation in robotics. You will be part of a team that's revolutionizing how robots learn, adapt, and interact with their environment.

Join us in building the next generation of intelligent robotics systems that will transform the future of automation and human-robot collaboration.

Key job responsibilities

• Design and implement whole body control methods for balance, locomotion, and dexterous manipulation
• Utilize state-of-the-art in methods in learned and model-based control
• Create robust and safe behaviors for different terrains and tasks
• Implement real-time controllers with stability guarantees
• Collaborate effectively with multi-disciplinary teams to co-design hardware and algorithms for loco-manipulation
• Mentor junior engineer and scientists

Basic Qualifications

• PhD, or Master's degree and 2+ years of CS, CE, ML or related field experience
• Experience with imitation learning and reinforcement learning for whole-body control
• Experience with methods such as hierarchical quadratic programming and model-predictive control
• Experience with simulation environments such as IsaacLab, Mujoco, Drake, etc.
• Experience with developing and deploying code for real-time controllers
• Experience in state estimation from multiple sensor modalities

Preferred Qualifications

• Experience in Java, C++, Python, or a related language
• Experience working effectively across cross-functional teams and partnering well with people at all levels within an organization
• PhD in Robotics, with a focus on whole-body control
• Experience with low-level joint torque/impedance control
• Experience with teleoperation systems
• Experience with robotics frameworks for fast prototyping (Matlab, ROS, etc.)

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn't listed, please contact your Recruiting Partner.

The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also offers comprehensive benefits including health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage), 401(k) matching, paid time off, and parental leave. Learn more about our benefits at https://amazon.jobs/en/benefits.

Preferred Qualifications

• Experience in Java, C++, Python, or a related language
• Experience working effectively across cross-functional teams and partnering well with people at all levels within an organization
• PhD in Robotics, with a focus on whole-body control
• Experience with low-level joint torque/impedance control
• Experience with teleoperation systems
• Experience with robotics frameworks for fast prototyping (Matlab, ROS, etc.)

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.

USA, MA, N.Reading - 142,800.00 - 193,200.00 USD annually

Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.