AI Systems Engineer: Scalable Backend & LLM Ops (RSU Eligible)

Pony.ai, Inc.; Fremont (CA); Hybrid; USD 120,000 - 200,000; Full time

Benefits offered by this job

Health Care Plan (Medical, Dental &amp

Retirement Plan (401k)

Life Insurance

Paid Time Off

Family Leave

Disability Insurance

Free Food & Snacks

Job summary

Pony.ai, Inc. in Fremont, CA, seeks an experienced AI systems engineer to design and optimize core decision-making components for autonomous mobility. You will build scalable data pipelines, backend services, and evaluation environments to support real-time operations.

The role requires strong C/C++ and Python skills, solid mathematical foundations, and a track record of building large-scale systems. Compensation ranges from $120,000 to $200,000 annually with bonuses and RSUs depending on

Qualifications

• BS/MS or Ph.D in Computer Science or related field.
• Strong programming skills in C/C++, Python and software design.
• Strong foundation in mathematics and theoretical CS (linear algebra, calculus, graph theory).
• Experience building large-scale systems with low latency.

Responsibilities

• Design and implement algorithms and evaluation metrics to drive core AI decision-making.
• Build scalable data pipelines and toolchains for large-scale data ingestion and evaluation.
• Design system-level evaluation metrics, testing frameworks, and simulation environments across components.
• Design and implement high-performance backend services and distributed architectures for real-time processing.
• Establish and maintain monitoring, observability, and alerting for reliable production operations.
• Build workflows for LLMs, guiding model reasoning and guardrails to ensure reliable outputs.

Skills

C/C++

Python

Software design

Mathematics

Education

BS/MS/PhD in CS or related field

Job description

Pony.ai, Inc. in Fremont, CA, seeks an experienced AI systems engineer to design and optimize core decision-making components for autonomous mobility. You will build scalable data pipelines, backend services, and evaluation environments to support real-time operations.

The role requires strong C/C++ and Python skills, solid mathematical foundations, and a track record of building large-scale systems. Compensation ranges from $120,000 to $200,000 annually with bonuses and RSUs depending on