Senior ML Systems Engineer - AI Evaluation Foundations
General Motors
Stand out for this role — generate a tailored resume and cover letter in about a minute.
Benefits offered by this job
Job summary
General Motors is seeking a Senior Engineer for the Embodied AI Scaling Foundations team to measure and visualize AV model performance at scale. You will design and implement evaluation and introspection tools used by GM AV teams, collaborating across Data, Infra, and validation groups.
You will influence model quality, deployment readiness, and data-driven decisions, working with model-based metrics, end-to-end simulation, and scalable workflows. Remote work is supported with travel as needed.
Qualifications
- 3+ years of relevant industry experience.
- Experience with Python, Node.js, React/TypeScript, and data/infra tools.
- Bachelor's degree in Computer Science or related field or equivalent experience.
Responsibilities
- Build evaluation signals and introspection tools for model evaluation.
- Develop visualization and metrics within the evaluation loop.
- Help teams introspect model behavior and drive actionable steps.
- Collaborate with Data, Infra, and validation teams to connect offline evaluation with real-world behavior.
Skills
Education
Tools
Job description
The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation.
The Evaluation Foundations team, part of Embodied AI's Scaling Foundations, solves critical evaluation challenges for autonomous vehicle development. We engineer high-performance tools that identify top-performing models and partner with data-intensive ML teams to drive rapid innovation.
Develop introspection and evaluation tools capable of processing billions of examples to extract maximum value from our large-scale datasets.
Join a high-impact team of engineers and machine learning scientists leveraging advanced AI to drive L2, L3, and L4 autonomous vehicle innovation.
Directly influence the safety, reliability, and scalability of next-generation autonomous systems.
As a Senior Engineer in the Embodied AI Scaling Foundations organization, you will be a key technical contributor on the team that measures and visualizes AV model performance. You will work across the stack to design, implement, and iterate on evaluation and introspection tools used by Embodied AI and adjacent GM AV teams In this role you will:
- Build and improve high-quality evaluation signal and introspection tools that help shorten the experimental path towards the best model.
- Develop and maintain visualization and metrics presentation within our model evaluation loop.
- Help teams introspect model behavior and reach actionable next steps with fewer manual steps.
- Participate in design and code reviews and work with Data, Infra, and validation teams to connect offline evaluation with real-world behavior.
You will collaborate closely with modeling and data scaling teams working on our Compound AI driving models to design and implement evaluation workflows at scale with model-based metrics, end-to-end simulation, and tooling that connects evaluation signals back to data, training, and launch decisions.
Your work contributes to a cohesive evaluation flywheel: better signal -> better data and training decisions -> better models -> better signal.
- 3+ years of relevant industry experience
- Familiarity and experience with at least some of the following key technologies:
- Backend: Python, node.js, high-throughput data streaming.
- Frontend: React/TypeScript, WebGL/WebGPU (for 3D sensor visualization), Streamlit, Jupyter notebooks.
- Data/Infra: Spark for stream processing, BigQuery, Kubernetes.
- Strong communication skills and ability to collaborate effectively across engineering partners.
- Bachelor's degree in Computer Science or related field or equivalent experience
- Previous experience in Robotics or Autonomous Driving
- 5+ years of relevant industry experience
- Master's or PhD degree in Computer Science or related field or equivalent experience
- Experience shipping production software and iterating quickly in a "startup within an enterprise" environment.
- The salary range for this role: is $144,700 to $261,300. The actual base salary a successful candidate will be offered within this range will vary based on factors relevant to the position.
- Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.
- Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more.
#GM-AV-1
This role is based remotely, but if the selected candidate lives within a specific mile radius of a GM hub, they will be expected to report to the location three times a week {or other frequency dictated by your manager}. The selected candidate will be required to travel <25% for this role. This job may be eligible for relocation benefits.
Our vision is a world with Zero Crashes, Zero Emissions and Zero Congestion and we embrace the responsibility to lead the change that will make our world better, safer and more equitable for all.
We believe we all must make a choice every day - individually and collaboratively - to drive meaningful change through our words, our deeds and our culture. Every day, we want every employee to feel they belong to one General Motors team.
From day one, we're looking out for your well-being - at work and at home - so you can focus on realizing your ambitions. Learn how GM supports a rewarding career that rewards you personally by visiting Total Rewards resources.
General Motors is committed to being a workplace that is not only free of unlawful discrimination, but one that genuinely fosters inclusion and belonging. We strongly believe that providing an inclusive workplace creates an environment in which our employees can thrive and develop better products for our customers.
All employment decisions are made on a non-discriminatory basis without regard to sex, race, color, national origin, citizenship status, religion, age, disability, pregnancy or maternity status, sexual orientation, gender identity, status as a veteran or protected veteran, or any other similarly protected status in accordance with federal, state and local laws.
We encourage interested candidates to review the key responsibilities and qualifications for each role and apply for any positions that match their skills and capabilities. Applicants in the recruitment process may be required, where applicable, to successfully complete a role-related assessment(s) and/or a pre-employment screening prior to beginning employment. To learn more, visit How we Hire.
General Motors offers opportunities to all job seekers including individuals with disabilities. If you need a reasonable accommodation to assist with your job search or application for employment, email us or call us at 1-800-865-7580. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
