(Senior) Software Engineer - Evaluation

Pony.ai; Fremont (CA); On-site; USD 120,000 - 250,000; Full time

Benefits offered by this job

Retirement Plan (Traditional and Roth 401k)

Life Insurance (Basic, Voluntary & AD&D)

Paid Time Off (Vacation & Public Holidays)

Family Leave (Maternity, Paternity)

Short Term & Long Term Disability

Free Food & Snacks

Job summary

Pony.ai in Fremont, California is looking for a talented engineer to design and build end-to-end data processing pipelines and high-performance backend services for real-time processing. The role involves collaborating across business components, driving architectural decisions, and building workflows for Large Language Models (LLMs).

The ideal candidate should possess strong programming skills in C/C++ and Python, along with a solid engineering background. Compensation ranges from $120,000 to $250,000 annually with various employee benefits.

Qualifications

• Strong foundation in mathematics and theoretical computer science.
• Experience in large data set processing and familiarity with real-time systems.
• Solid experience in a fast-paced and structured engineering environment.

Responsibilities

• Design and build data processing pipelines and toolchains.
• Implement high-performance backend services for real-time processing.
• Lead the design of system-level evaluation metrics and testing frameworks.

Skills

Programming in C/C++

Python

Software design

Large data set processing

Full stack experience

Statistical analysis

Education

BS/MS or Ph.D in Computer Science or related field

Job description

Responsibility

• Design and build end-to-end data processing pipelines and toolchains to support large-scale data collection, batch processing, curation, and multi-dimensional evaluation.
• Design and implement high-performance backend services and distributed architectures , capable of handling large-scale real-time event processing.
• Collaborate across complex business components to lead the design of targeted system-level evaluation metrics, testing frameworks, and advanced simulation environments.
• Leverage and improve industry-leading, open-source distributed technologies to continuously advance infrastructure capabilities and processing efficiency.
• Drive critical architectural decisions and technology selection, ensuring rigorous standards for security, stability, scalability, and high performance.
• Establish and maintain comprehensive system monitoring, fine-grained observability metrics, and automated alerting frameworks to ensure low latency and reliable production operations.
• Build and optimize downstream engineering workflows for Large Language Models (LLMs), programmatically steering model reasoning, establishing guardrails, and mitigating hallucinations to ensure reliable outputs.

Requirements

• Strong programming skills in C/C++, Python, and software design
• Strong foundation in mathematics and theoretical computer science, such as linear algebra, calculus, graph theory, computational geometry, combinatorial optimization algorithms, stochastic processes, and complexity analysis.
• Possessing solid engineering discipline, or demonstrating strong interest and potential in building large-scale systems, with the ability to maximize performance while keeping complexity and cost to a minimum.
• Pursueing a BS/MS or Ph.D in Computer Science or a related field
• Experience in large data set processing and familiarity with real time systems
• Solid experience in a fast-paced and structured engineering environment
• Full stack experience including both front end and back end is preferred
• Statistics analysis experience is preferred

Compensation and Benefits

Base Salary Range: $120,000 - $250,000 Annually

Compensation may vary outside of this range depending on many factors, including the candidate’s qualifications, skills, competencies, experience, and location. Base pay is one part of the Total Compensation and this role may be eligible for bonuses/incentives and restricted stock units.

Also, we provide the following benefits to eligible employees:

• Retirement Plan (Traditional and Roth 401k)
• Life Insurance (Basic, Voluntary & AD&D)
• Paid Time Off (Vacation & Public Holidays)
• Family Leave (Maternity, Paternity)
• Short Term & Long Term Disability
• Free Food & Snacks