Engineering Manager - Autonomy Subsystem Evaluation

General Motors Company; Sunnyvale (CA); Hybrid; USD 219,000 - 335,000; Full time

Benefits offered by this job

Company vehicle program

Job summary

General Motors Company seeks a Manager of Subsystem Evaluation to lead a team of engineers and data scientists. You will own the roadmap, execution, and staffing, and link subsystem metrics to driving outcomes.

You will collaborate with autonomy teams and leadership to prioritize work and improve evaluation methods. You will report to the Senior Manager of Eval Applications and drive impactful measurement strategies across perception, planning, and localization; this role combines leadership

Qualifications

• 8+ years in autonomous systems, robotics, ML evaluation, or applied data science with hands-on evaluation.
• 3+ years managing engineers or data scientists, including hiring and performance management.
• Deep knowledge of autonomy metrics and their limits, including planner and trajectory metrics.
• Strong statistics for evaluation, including design of experiments and hypothesis testing on time-series data.
• A disciplined approach to root-causing anomalous data and unexpected system behavior.
• Production Python and SQL experience in team environments; comfortable reviewing designs and code; read C++ autonomy code.

Responsibilities

• Set roadmap and quarterly plans for subsystem evaluation aligned with AV program milestones.
• Build metrics weighting subsystem errors by their effect on downstream decisions and driving.
• Trace bad driving to subsystems or interactions and quantify impact on outcomes.
• Deliver fast, trustworthy answers on software or model changes and regression detection.
• Ensure metrics meet driving outcomes and confidence bounds; retire weak ones.
• Apply ML tools effectively in development processes and turn results into clear findings for teams and leadership.

Skills

Autonomous systems

Robotics

ML evaluation

Applied data science

Engineering management

Python

SQL

C++

Education

Bachelor's, Master's, or PhD in Computer Science, Robotics, Mechanical or Aerospace Engineering, Machine Learning, Statistics, Data Science, or related field

Tools

Python

SQL

C++

Job description

About the Organization

GM has more than 500,000 Super Cruise-equipped vehicles on the road and over 700 million hands-free miles driven. We're now building the next generation of autonomous driving, starting with eyes-off driving on the highway and growing toward point-to-point autonomy. The goal is autonomy that is safe, reliable, comfortable, and scalable across GM's vehicle portfolio.

Autonomy Evaluation helps the AV program figure out where the driver still falls short. Every mile our vehicles drive, on the road or in simulation, carries that signal. We turn it into answers: what is limiting the system, how big each problem is, and what fixing it is worth. Those answers steer what GM's autonomy teams build next and inform software release decisions.

Subsystem Evaluation is one of four teams in Eval Applications, the part of Autonomy Evaluation that turns evaluation into decisions. Each autonomy team measures its own component, usually by accuracy against labels. We answer the question those metrics can't: how much does each subsystem's error actually affect driving? We build metrics for planning, perception, prediction, and localization, including learned components, that reflect their effect on the drive. We also trace driving failures back to the subsystem or interaction that caused them.

The Role

As Manager of Subsystem Evaluation, you'll lead a team of engineers and data scientists and own its roadmap, execution, and staffing. The work is concrete. One example is showing which perception errors change what the car does and which don't. Another is ranking the subsystem failures behind a drop in driving quality, so the right team fixes the right thing first. You'll work with the autonomy teams that use these metrics, with the Driver Performance and Scenario Classification teams, and with the principal and staff engineers who lead evaluation methodology. You'll report to the Senior Manager of Eval Applications.

What You'll Do

• Set the roadmap and quarterly plans for subsystem evaluation, tied to the AV program's milestones and release needs. Decide which subsystems and questions come first, and what to stop.
• Build metrics that weight subsystem errors by their effect on downstream decisions and driving, not by accuracy alone.
• Trace bad driving in simulation and road data back to the subsystem or interaction that caused it, and measure how subsystem errors add up to driving outcomes.
• Give autonomy teams and release reviews a fast, trustworthy answer to whether a software or model change helped or hurt driving, including regression detection and version-to-version comparison.
• Hold the metrics themselves to a high bar. Check them against driving outcomes and human judgment, state their confidence and limits, and retire the ones that don't hold up.
• Apply VLMs and LLMs effectively where applicable in the development/trigaging/etc processes.
• Turn results into clear findings for autonomy teams and leadership: what changed, how confident we are, and what to fix first.

Leadership Responsibilities

• Hire, develop, and retain engineers and data scientists, with clear expectations, regular feedback, and fair performance management.
• Set clear ownership and steady operating rhythms. Keep the technical bar high through design reviews, code review, testing, and statistically sound analysis.
• Balance near-term program requests against longer-term investments in metrics and methods.
• Build trust with autonomy teams so they act on our metrics. Agree with them on where their component metrics end and ours begin, and resolve disagreements over priorities or conflicting results.

Your Skills & Abilities (Required Qualifications)

• 8+ years in autonomous systems, robotics, ML evaluation, or applied data science, including hands-on evaluation of planning, perception, prediction, or localization.
• 3+ years managing engineers or data scientists, including hiring and performance management.
• Deep knowledge of autonomy metrics and their limits, such as planner quality measures, detection and tracking metrics, and trajectory prediction metrics. You can tell when a metric improves without the system getting better.
• Strong statistics for evaluation, including sampling, confidence intervals, experimental design, and hypothesis testing on time-series data.
• A disciplined approach to root-causing anomalous data and unexpected system behavior.
• Production Python and SQL experience in team environments, and comfort reviewing designs and code.
• Comfort reading C++ autonomy code to understand what a subsystem actually does.
• Proven ability to build trusted relationships with partner teams and influence them without authority, using data they trust.
• Strong ability to turn ambiguous questions and uncertain results into clear plans and recommendations for engineering and leadership.
• Bachelor's, Master's, or PhD in Computer Science, Robotics, Mechanical or Aerospace Engineering, Machine Learning, Statistics, Data Science, or a related field, or equivalent practical experience.

What Will Give You a Competitive Edge (Preferred Qualifications)

• Experience in autonomous driving or driver assistance, working with simulation and on-road data, including camera, lidar, and radar.
• Understanding of vehicle dynamics, and planning & controls system design.
• Experience with causal or counterfactual analysis.
• Experience with ML interpretability, such as attribution, ablations, or embedding analysis.
• Strong data-visualization instincts, with the ability to turn high-dimensional metrics into clear views for technical and non-technical audiences.
• Experience leading mixed teams of software engineers and data scientists.

Work Arrangement: This role is categorized as Remote/ hybrid . Remote:This role is basedremotely but if you live within a 50-mile radius of [Austin, Detroit, Warren,Milford, Sunnyvale, CA ], you are expected to report to that location three timesperweek, at minimum.

Compensation : The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of the California Bay Area.

• The salary range for this role is ($218,800 - $335,300). The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position.

• Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.

Company Vehicle : Upon successful completion of a motor vehicle report review, you will be eligible to participate in a company vehicle evaluation program, through which you will be assigned a General Motors vehicle to drive and evaluate. Note: program participants are required to purchase/lease a qualifying GM vehicle every four years unless one of a limited number of exceptions applies.