Autonomy Metrics Platform Engineer II

Rivian; Palo Alto (CA); On-site; USD 142,000 - 178,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

Job summary

Rivian seeks a metrics-platform engineer for the Autonomy Eval Infrastructure team in California. You will build backend services, Python libraries and data pipelines to turn model outputs into reproducible measurements and meaningful comparisons, supporting evaluation across simulation and real-world vehicle data.

You will own components from implementation through deployment, collaborate with Perception, Planning and Systems engineers, and help shape a shared platform while growing your

Qualifications

• 2+ years of software engineering experience, or equivalent demonstrated experience building and maintaining substantial software systems.
• Strong Python programming skills and a solid foundation in data structures, algorithms, software design and debugging.
• Practical SQL skills, with AI coding tools expected to support writing and refining queries; ability to validate query logic, results and performance.
• Experience building backend services, reusable libraries or data-processing pipelines with automated tests, version control and code review.
• Ability to reason about APIs, data models and component design, explain trade-offs, and identify failure cases such as duplicate, delayed or missing data.
• Experience with cloud services, containers and CI/CD, and an understanding of how software is deployed and monitored in production.
• Care with data correctness and basic statistical reasoning, including sample sizes, rates and variability; curiosity about how measurements reflect real driving behavior.
• Clear written communication and a collaborative approach to gathering requirements, asking for feedback and resolving technical problems.
• Bonus Points Hands-on experience with ML models using PyTorch or similar frameworks, such as running inference or analyzing prediction errors; experience in autonomy, robotics or simulation.
• Experience with distributed data processing or analytical storage, such as Spark, Databricks, Delta Lake or comparable systems.
• Experience with AWS, Docker and GitLab CI, or with developer tools, experiment tracking, data lineage or results visualization. Prior autonomy or robotics experience is welcome but is not required for this role.

Responsibilities

• Build and test services, APIs and libraries for registering metric definitions, computing results and retrieving them consistently across engineering tools.
• Implement scalable metric-processing pipelines with safe retries, incremental computation and backfills. Make missing inputs, failed jobs and incomplete results visible.
• Capture code, metric, model, dataset and scenario versions so a reported result can be traced to its inputs and reproduced.
• Build tools for comparing model versions and exploring results by scenario, geography, vehicle platform and operating conditions, using consistent aggregation and denominators.
• Work with model developers to run evaluation experiments, inspect predictions and investigate failure patterns. Help translate findings into targeted evaluation datasets and regression tests.
• Integrate metrics into evaluation workflows, CI regression checks and release scorecards, and connect results to recordings and triage tools for investigation.
• Improve automated tests, performance, observability and deployment tooling. Debug production issues and document the components you support.
• Work with engineers in Palo Alto, London and Belgrade to turn user needs into maintainable software, participate in design and code reviews, and deliver improvements iteratively.

Skills

Python

SQL

Backend services

APIs

Cloud

CI/CD

Data correctness

Communication

PyTorch

Robotics

Spark

Databricks

Delta Lake

AWS

Docker

GitLab CI

Experiment tracking

Data lineage

Results visualization

Tools

Spark

Databricks

Delta Lake

AWS

Docker

GitLab CI

Experiment tracking

Data lineage

Results visualization

Job description

Rivian seeks a metrics-platform engineer for the Autonomy Eval Infrastructure team in California. You will build backend services, Python libraries and data pipelines to turn model outputs into reproducible measurements and meaningful comparisons, supporting evaluation across simulation and real-world vehicle data.

You will own components from implementation through deployment, collaborate with Perception, Planning and Systems engineers, and help shape a shared platform while growing your