Senior Software Engineer - Evaluation

Pony.ai; Fremont (CA); On-site; USD 120,000 - 220,000; Full time

Benefits offered by this job

Health care plan

Retirement plan

Life insurance

Paid time off

Family leave

Disability (short/long)

Job summary

Pony.ai, founded in Silicon Valley, is seeking a highly skilled engineer to design and build end-to-end data processing pipelines and high-performance backend services for large-scale autonomous mobility initiatives.

You will collaborate across teams to shape evaluation metrics, testing frameworks, and simulation environments, while leveraging open-source technologies to improve infrastructure and processing efficiency.

Qualifications

• Strong programming skills in C/C++, Python.
• Solid foundation in mathematics and CS theory (linear algebra, calculus, graph theory).
• Experience building large-scale systems with performance and cost considerations.
• Pursuing BS/MS or Ph.D in CS or related field.

Responsibilities

• Design and build end-to-end data processing pipelines and toolchains for large-scale data collection, processing, and evaluation.
• Design and implement high-performance backend services and distributed architectures for real-time event processing.
• Collaborate across business components to design evaluation metrics, testing frameworks, and simulation environments.
• Leverage open-source distributed technologies to advance infrastructure and processing efficiency.
• Drive architectural decisions, ensuring security, stability, and scalability.
• Establish system monitoring and observability to ensure low latency and reliable operations.
• Build and optimize workflows for LLMs, guiding model reasoning and reducing hallucinations.

Skills

C/C++

Python

Software design

Mathematics & CS theory

Real-time systems

Full stack development

Statistics

Education

BS/MS/PhD in Computer Science or related

Tools

Distributed systems

Job description

Founded in 2016 in Silicon Valley, Pony.ai has quickly become a global leader in autonomous mobility and is a pioneer in extending autonomous mobility technologies and services at a rapidly expanding footprint of sites around the world. Operating Robotaxi, Robotruck and Personally Owned Vehicles (POV) business units, Pony.ai is an industry leader in the commercialization of autonomous driving and is committed to developing the safest autonomous driving capabilities on a global scale. Pony.ai's leading position has been recognized, with CNBC ranking Pony.ai #10 on its CNBC Disruptor list of the 50 most innovative and disruptive tech companies of 2022. In June 2023, Pony.ai was recognized on the XPRIZE and Bessemer Venture Partners inaugural "XB100" 2023 list of the world's top 100 private deep tech companies, ranking #12 globally. As of August 2023, Pony.ai has accumulated nearly 21 million miles of autonomous driving globally. Pony.ai went public at NASDAQ in November 2024.

Responsibility

• Design and build end-to-end data processing pipelines and toolchains to support large-scale data collection, batch processing, curation, and multi-dimensional evaluation
• Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing
• Collaborate across complex business components to lead the design of targeted system-level evaluation metrics, testing frameworks, and advanced simulation environments
• Leverage and improve industry-leading, open-source distributed technologies to continuously advance infrastructure capabilities and processing efficiency
• Drive critical architectural decisions and technology selection, ensuring rigorous standards for security, stability, scalability, and high performance
• Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations
• Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs

Requirements

• Strong programming skills in C/C++, Python, and software design
• Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis.
• Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum
• Pursueing a BS/MS or Ph.D in Computer Science or a related field
• Experience in large data set processing and familiarity with real time systems
• Solid experience in a fast-paced and structured engineering environment
• Full stack experience including both front end and back end is preferred
• Statistics analysis experience is preferred

Compensation And Benefits

Base Salary Range: $120,000 - $220,000 Annually

Compensation may vary outside of this range depending on many factors, including the candidate's qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.

Also, we provide the following benefits to eligible employees:

• Health Care Plan (Medical, Dental & Vision)
• Retirement Plan (Traditional and Roth 401k)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation & Public Holidays)
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Free Food & Snacks