Senior Software Systems Engineer, Autonomous Vehicles - Metrics & Evaluation

General Motors Company; Sunnyvale (CA); On-site; USD 153,000 - 234,000; Full time

Benefits offered by this job

Bonus potential

Health and wellbeing benefits

Job summary

General Motors is seeking a technically adept professional to own end-to-end evaluation of our autonomous vehicle ML stack. You will define robust AV evaluation processes, implement infrastructure for performance assessment from simulation and road data, and drive metrics that improve our validation workflows.

The role requires strong Python/SQL, ELT experience, and the ability to communicate complex AI insights to executives.

Qualifications

• Strong Python and SQL programming
• Experience with ELT pipelines for product quality analysis
• Experience with GitHub and Jira or equivalent tools
• Analytical and systems engineering skills for complex AI systems
• Root cause analysis in complex SW/HW systems

Responsibilities

• Define an AV evaluation process from conception to release of the end-to-end ML stack.
• Implement infrastructure solutions to assess AV performance using simulation and on-road data.
• Identify metrics to improve evaluation workflows and plan implementation.
• Contribute to automated triage strategies for AV deficiencies in an End-to-End stack.
• Articulate insights and recommendations to AV developers and executives based on analysis.
• Maintain scalable processes to monitor and improve evaluation KPIs.
• Align continuous improvement processes with product safety and safety standards.

Skills

Python

SQL

AI tooling

ELT pipelines

GitHub/Jira

Problem solving

Root cause analysis

Cross-functional communication

Education

BS in Engineering

MS in Engineering

PhD in Engineering

Job description

Job Description

The Role

You will be part of a team that drives systematic and data-driven improvements to the Autonomous Vehicle software by designing, implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve this objective, we are looking for a highly motivated individual with excellent analytical skills to own end to end execution, methodology improvements and insight articulation/communication to ensure high-quality evaluation and release of our End-to-End ML Stack.

In this position, you will work closely with AI/ML Engineers, Simulation Engineers, Systems Engineers, Product Managers to identify, analyze, monitor and prioritize the most important signals to assess performance of our ML based stack leveraging simulation and on-road data and building scalable processes to evaluate compliance to our KPIs.

What you’ll be doing:

• Define an AV evaluation process that spans from initial conception through implementation, ensuring it is applied to the release of our end-to-end (E2E) ML stack.
• Provide hands‑on implementation of infrastructure solutions to assess AV performance from ELT tooling at GM from simulation and on‑road data.
• Proactively scope and identify metrics needed to improve our evaluation workflows and devise paths for implementation if not available.
• Contribute to automated triage strategies for AV deficiencies in an End-to‑End stack architecture and present findings to relevant stakeholders.
• Articulate insights, summaries and recommendations to AV developers and executives based on continuous analysis of AV performance.
• Define and maintain scalable processes to identify, monitor and improve evaluation KPIs as definition of success of evaluation initiatives.
• Map and articulate link between continuous improvement processes with the product safety case and compliance with safety standards.

What you must have:

• Strong Python and SQL programming
• Strong skills in high quality SW Development using AI tools
• Prior knowledge and implementation of ELT pipelines for product quality analysis
• Experience with GitHub and Jira or equivalent tools
• Strong problem‑solving skills - End to End ownership from problem definition to deriving the desired outcome
• Proven track record of analytical and systems engineering skills while dealing with complex systems and ambiguous AI functions
• Proven track record of root cause analysis in complex SW/HW systems
• Familiarity with analytical methods for driving behavioral analysis
• Ability to creatively problem solve with limited supervision
• Motivated by a fast paced, challenging environment with high expectations and quick turnarounds
• Ability to learn quickly, starting with little information and quickly becoming an expert in your domain
• Strong cross functional communication and collaboration skills
• Proven experience at communicating data driven decisions to leadership
• Passionate about robotics/AI complexities
• BS , MS or PhD in Engineering or related discipline or equivalent combination education and experience

Bonus Points!

• Experience with AVs and/or Production grade robotics developments and AV/ADAS systems
• Experience with statistical methods for product evaluation and risk assessment
• Experience with developing data driven metrics

Compensation

The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington.

• The salary range for this role: is $153,200 to $234,100. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position.
• Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.
• Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more

About GM

Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.

Why Join Us

We believe we all must make a choice every day – individually and collectively – to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team.

Benefits Overview

From day one, we're looking out for your well-being–at work and at home–so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.

Non-Discrimination and Equal Employment Opportunities (U.S.)

General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers.

All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws.

We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre‑employment screening prior to beginning employment. To learn more, visit How we Hire.

Accommodations

General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us or call us at 1-800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.