Senior Software Systems Engineer, Autonomous Vehicles - Metrics & Evaluation

General Motors Corporation; Sunnyvale (CA); Hybrid; USD 153.000 - 234.000; Vollzeit

Zusammenfassung

General Motors seeks a Senior Software Systems Engineer for Autonomous Vehicles — Metrics & Evaluation in Sunnyvale, CA. You will design, implement, and maintain robust evaluation/validation processes for the end-to-end ML stack, collaborating with AI/ML, Simulation, and Systems engineers to improve KPIs and release quality.

You will define AV evaluation pipelines from concept to deployment, build ELT-enabled analytics, and communicate data-driven insights to stakeholders, driving safer

Qualifikationen

• Strong Python and SQL programming.
• Strong skills in high quality SW development using AI tools.
• Prior knowledge and implementation of ELT pipelines for product quality analysis.
• Experience with GitHub and Jira or equivalent tools.
• Strong problem-solving skills - End to End ownership from problem definition to deriving the desired outcome.
• Proven track record of analytical and systems engineering skills while dealing with complex systems and ambiguous AI functions.
• Proven track record of root cause analysis in complex SW/HW systems.
• Familiarity with analytical methods for driving behavioral analysis.
• Ability to creatively problem solve with limited supervision.
• Motivated by a fast paced, challenging environment with high expectations and quick turnarounds.
• Ability to learn quickly, starting with little information and quickly becoming an expert in your domain.
• Strong cross functional communication and collaboration skills.
• Proven experience at communicating data driven decisions to leadership.
• Passionate about robotics/AI complexities.
• BS , MS or PhD in Engineering or related discipline or equivalent combination education and experience

Aufgaben

• Define an AV evaluation process spanning from conception to release of the end-to-end ML stack.
• Provide hands-on implementation of infrastructure solutions to assess AV performance from simulation and on-road data.
• Scope and identify metrics to improve evaluation workflows and plan implementations.
• Contribute to automated triage strategies for AV deficiencies in an End-to-End stack and present findings to stakeholders.
• Articulate insights, summaries and recommendations to AV developers and executives based on ongoing analysis of AV performance.
• Define and maintain scalable processes to identify, monitor and improve evaluation KPIs as success of evaluation initiatives.
• Map and articulate links between continuous improvement processes and the product safety case and safety standards.

Kenntnisse

Python

SQL

End-to-End ownership

Root cause analysis

Behavioral analysis

Cross-functional communication

Problem solving

Analytical skills

Ausbildung

BS/MS/PhD in Engineering

Tools

GitHub

Jira

ELT Pipelines

AI Tools

Jobbeschreibung

## Senior Software Systems Engineer, Autonomous Vehicles - Metrics & EvaluationApply: Hybrid: Sunnyvale, California, United States of America: Full time: Posted Today: JR-202619949**Job Description****The Role**You will be part of a team that drives systematic and data-driven improvements to the Autonomous Vehicle software by designing, implementing, and maintaining robust processes for evaluation and validation of our AVs. To achieve this objective, we are looking for a highly motivated individual with excellent analytical skills to own end to end execution, methodology improvements and insight articulation/communication to ensure high-quality evaluation and release of our End-to-End ML Stack.In this position, you will work closely with AI/ML Engineers, Simulation Engineers, Systems Engineers, Product Managers to identify, analyze, monitor and prioritize the most important signals to assess performance of our ML based stack leveraging simulation and on-road data and building scalable processes to evaluate compliance to our KPIs.If you're interested in having a major impact on accelerating AV Behavioral Evaluation assessment on ML-driven autonomy through creative problem solving, let's chat!**What you’ll be doing:*** Define an AV evaluation process that spans from initial conception through implementation, ensuring it is applied to the release of our end-to-end (E2E) ML stack.* Provide hands-on implementation of infrastructure solutions to assess AV performance from ELT tooling at GM from simulation and on-road data.* Proactively scope and identify metrics needed to improve our evaluation workflows and devise paths for implementation if not available.* Contribute to automated triage strategies for AV deficiencies in an End-to-End stack architecture and present findings to relevant stakeholders.* Articulate insights, summaries and recommendations to AV developers and executives based on continuous analysis of AV performance.* Define and maintain scalable processes to identify, monitor and improve evaluation KPIs as definition of success of evaluation initiatives.* Map and articulate link between continuous improvement processes with the product safety case and compliance with safety standards.**What you must have:*** Strong Python and SQL programming* Strong skills in high quality SW Development using AI tools* Prior knowledge and implementation of ELT pipelines for product quality analysis* Experience with GitHub and Jira or equivalent tools* Strong problem-solving skills - End to End ownership from problem definition to deriving the desired outcome* Proven track record of analytical and systems engineering skills while dealing with complex systems and ambiguous AI functions* Proven track record of root cause analysis in complex SW/HW systems* Familiarity with analytical methods for driving behavioral analysis* Ability to creatively problem solve with limited supervision* Motivated by a fast paced, challenging environment with high expectations and quick turnarounds* Ability to learn quickly, starting with little information and quickly becoming an expert in your domain* Strong cross functional communication and collaboration skills* Proven experience at communicating data driven decisions to leadership* Passionate about robotics/AI complexities* BS , MS or PhD in Engineering or related discipline or equivalent combination education and experience**Bonus Points!*** Experience with AVs and/or Production grade robotics developments and AV/ADAS systems* Experience with statistical methods for product evaluation and risk assessment* Experience with developing data driven metrics**Compensation:** The compensation information is a good faith estimate only. It is based on what a successful applicant might be paid in accordance with applicable state laws. The compensation may not be representative for positions located outside of New York, Colorado, California, or Washington. · **The salary range for this role:** is $153,200 to $234,100. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position. · **Bonus Potential:** An incentive pay program offers payouts based on company performance, job level, and individual performance. · **Benefits:** GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more