Software Engineer, Deep Learning

Pony.ai; Fremont (CA); On-site; USD 140,000 - 280,000; Full time

Benefits offered by this job

Retirement Plan (Traditional & Roth 4

Life Insurance

Paid Time Off

Family Leave

Disability Insurance

Free Food & Snacks

Job summary

Pony.ai is seeking talented ML engineers to advance autonomous mobility. You will work on software architecture for self-driving vehicles, design scalable ML systems, and deploy models that operate in real-time on cars.

The role emphasizes C++/Python expertise, data-driven development, and collaboration with a world-class team. The position involves building large-scale foundation models, including vision-language and LLMs, and optimizing performance under stringent runtime constraints.

Qualifications

• Master in Computer Science, or at least 2 years of equivalent industry experience in similar technical fields.
• Solid understanding of data structures, algorithms, parallel computing, code optimization and large scale data processing.
• Experience in applied machine learning including data collection and analysis, evaluation and feature engineering.
• Expertise in C++/Python.
• Strong communication skills and team spirit.

Responsibilities

• Work with experts in the field of self-driving vehicles on software architecture and design, system and module design, evaluation metrics, specification and implementation of test and regression frameworks.
• Design and develop large-scale foundation models trained on vast of real world data.
• Frame the open-ended real-world problems into well-defined ML problems; develop and apply cutting-edge ML approaches to these problems; scale them to data pipelines; and streamline them to run in real-time on the cars.
• Develop and deploy deep learning models, including vision language models (VLMs) and Large Language Models (LLMs).
• Optimize deep learning models to run robustly under tight run-time constraints.

Skills

C++/Python

Data structures

Algorithms

Parallel computing

Code optimization

Large-scale data processing

Communication

Teamwork

Education

Master in Computer Science

Equivalent industry experience

Tools

CUDA/TensorRT

Job description

Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai’s leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural “XB100” 2023 list of the world’s top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 21 million miles of autonomous driving globally. Pony.ai went public at NASDAQ in November 2024.

Responsibility

• Work with experts in the field of self-driving vehicles on software architecture and design, system and module design, evaluation metrics, specification and implementation of test and regression frameworks.
• Design and develop large-scale foundation models trained on vast of real world data
• Frame the open-ended real-world problems into well-defined ML problems; develop and apply cutting-edge ML approaches (deep learning, reinforcement learning, imitation learning, etc) to these problems; scale them to data pipelines; and streamline them to run in real-time on the cars.
• Develop and deploy deep learning models, including vision language models (VLMs) and Large Language Models (LLMs)
• Optimize deep learning models to run robustly under tight run-time constraints.

Requirements

• Master in Computer Science, or at least 2 years of equivalent industry experience in similar technical fields.
• Solid understanding of data structures, algorithms, parallel computing, code optimization and large scale data processing.
• Experience in applied machine learning including data collection and analysis, evaluation and feature engineering.
• Expertise in C++/Python.
• Strong communication skills and team spirit.

Preferred Experience

• PhD in Deep Learning, Machine Learning, Robotics, Natural Language Processing, or similar technical field of study.
• Publications on top-tier conferences like CVPR/ICCV/ECCV/ICLR/ICML/NeurIPS/ICLR/AAAI/IJCV/PAMI
• Experience in applying ML/DL for behavior prediction, imitation learning, motion planning.
• Experience in deploying deep learning algorithms for real time applications, with limited computing resources.
• Experience in convex optimization, computational geometry or linear algebra.
• Experience in GPU/CUDA/TensorRT

Compensation and Benefits

Base Salary Range: $140,000 - $280,000 Annually

Compensation may vary outside of this range depending on many factors, including the candidate’s qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.

Also, we provide the following benefits to the eligible employees:

• Retirement Plan (Traditional and Roth 401k)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation & Public Holidays)
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Free Food & Snacks

Please click here for our privacy disclosure.