Senior Reinforcement Learning Engineer - Robotics

Socket.dev; Santa Clara (CA); On-site; USD 174,720 - 295,680; Full time

Benefits offered by this job

Competitive compensation

Snacks & meals

Opportunity to work on cutting edge技hn

Job summary

XPENG in Santa Clara is seeking a researcher engineer to advance deep-learning methods for legged robots and to develop end-to-end motion controllers using reinforcement learning and imitation learning. You will design experiments, evaluate controllers, and address sim-to-real challenges.

The role requires advanced degree, Python proficiency, 1–3+ years in DL with PyTorch, and practical RL experience with PPO, DQN, SAC. Experience with C++ and robotics hardware is a plus.

Qualifications

• Advanced degree in Mechanical Engineering, Computer Science, Robotics, or a related field.
• Proficiency in Python and strong software design skills.
• 1–3+ years of experience with deep learning frameworks like PyTorch.
• Strong understanding of reinforcement learning and imitation learning techniques.
• Experience applying PPO, DQN, SAC to real-world problems.

Responsibilities

• Research, implement, and evaluate deep-learning-based methods for legged locomotion and whole-body control problems in humanoid robots.
• Develop and refine end-to-end robot motion controllers using reinforcement learning, imitation learning, or other advanced techniques.
• Design, execute, and analyze experiments to evaluate RL controllers and address sim-to-real challenges.
• Stay updated and integrate the latest advancements in academic and engineering research for humanoid robotics.

Skills

Python

PyTorch

Reinforcement learning

Imitation learning

C++

Education

Advanced degree in Mechanical Engineering, Computer Science, Robotics, or related field

Tools

ROS

C++

Job description

XPENG is a leading smart technology company at the forefront of innovation, integrating advanced AI and autonomous driving technologies into its vehicles, including electric vehicles (EVs), electric vertical take-off and landing (eVTOL) aircraft, and robotics. With a strong focus on intelligent mobility, XPENG is dedicated to reshaping the future of transportation through cutting-edge R&D in AI, machine learning, and smart connectivity.

Job Responsibilities:

• Research, implement, and evaluate deep-learning-based methods for legged locomotion and whole-body control problems in humanoid robots.
• Develop and refine end-to-end robot motion controllers using reinforcement learning, imitation learning, or other advanced techniques.
• Design, execute, and analyze experiments to evaluate RL controllers and address sim-to-real challenges.
• Stay updated and integrate the latest advancements in academic and engineering research for humanoid robotics.

Minimum Requirements:

• Advanced degree in Mechanical Engineering, Computer Science, Robotics, or a related field. Open to fresh graduates.
• Proficiency in Python and strong software design skills.
• 1-3+ years of experience with deep learning frameworks like PyTorch.
• Strong understanding of reinforcement learning and imitation learning techniques.
• Proven experience applying algorithms such as PPO, DQN, SAC, etc., to real-world problems.

Preferred Requirements:

• Experience with C++ is a plus.
• Hands-on experience with the control and operation of legged robot hardware is highly preferred.

What do we provide:

• A fun, supportive and engaging environment.
• Opportunities to make a significant impact on the future of transportation and robotics.
• Opportunity to work on cutting edge technologies with the top talent in the field.
• Competitive compensation package & benefits.
• Snacks, lunches, and fun activities.
• The base salary range for this full-time position is $174,720 - $295,680, in addition to bonus, equity and benefits. Our salary ranges are determined by role, level, and location. The range displayed on each job posting reflects the minimum and maximum target for new hire salaries for the position across all US locations. Within the range, individual pay is determined by work location and additional factors, including job-related skills, experience, and relevant education or training.
• We are an Equal Opportunity Employer. It is our policy to provide equal employment opportunities to all qualified persons without regard to race, age, color, sex, sexual orientation, religion, national origin, disability, veteran status or marital status or any other prescribed category set forth in federal or state regulations.