Software Engineer, ML Inference Platform

Socket.dev; Mountain View (CA); On-site; USD 160,000 - 241,000; Full time

Job summary

Nuro is seeking an ML Infrastructure engineer to help design, build, and deploy core ML infrastructure for autonomy teams. You will work across the full stack of ML solutions, from data pipelines to deploying models on Nuro’s fleet of self-driving robots.

The role emphasizes performance, scalability, and distributed systems while collaborating with multiple teams to advance autonomous technology and safety. Competitive compensation and benefits accompany the position.

Qualifications

• Degree in BS, MS, or PhD with 1+ years of relevant experience.
• Strong proficiency in Python; familiarity with C++.
• Technical excellence: high performance, scalability, and code quality.
• Domain experience: ML pipelines and distributed systems understanding.
• Independence and productivity: able to learn quickly and tackle complex systems.

Responsibilities

• Design and develop ML workflow pipelines to train, optimize, validate, and deploy ML models.
• Develop and maintain continuous testing and monitoring for core ML infrastructure components.
• Develop observability to track ML model lifecycles from data generation to on-road validation.
• Maintain an in-house ML inference platform to serve large language models efficiently.
• Maintain an in-house ML compiler platform to deploy and validate models on various hardware.

Skills

Python

C++

Distributed systems

Code quality

Education

BS/MS/PhD in CS or related

Tools

TensorFlow

PyTorch

Git

Job description

Who We Are

Nuro believes self-driving vehicles are the most immediate and profound opportunity for AI to drive positive change in the physical world. Safer streets, more time for what matters, and easier access to the world around us, that’s why we’re building a universal autonomy platform: self-driving for all roads and all rides. Founded in 2016, Nuro is a physical AI company developing Level 4 autonomous driving technology for a wide range of vehicles, use cases, and markets. Powered by the Nuro Driver™, our universal autonomy platform enables the global mobility ecosystem to deploy autonomy at scale, from robotaxis and logistics fleets to personal vehicles. With years of real-world deployment experience and a flexible, partner-led business model, Nuro is working toward a future where millions of autonomous vehicles powered by our technology help make everyday life safer, easier, and more connected. Nuro has raised over $2B in capital from Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.

About the Role

The ML Infrastructure team is responsible for building & improving the core infrastructure for autonomy teams at Nuro. In this role, you will work closely with teams across Nuro, to design, build and deploy core infrastructure components in machine learning model life cycle, to push the autonomous future forward. You will have an opportunity to work across the full stack of machine learning solutions - from designing robust and scalable model & data pipelines to building to deploying the optimized models on Nuro’s fleet of self-driving robots!

About the Work

• Design and develop ML workflow pipelines to train, optimize, validate, and deploy Nuro autonomy models.
• Develop and maintain continuous testing and monitoring systems for core ML infrastructure components.
• Develop observability to track ML model lifecycles from data generation to on-road validation.
• Maintain an in-house ML inference platform to serve large language models efficiently.
• Maintain an in-house ML compiler platform to compile, deploy, and validate Nuro autonomy models to various hardware platforms.

About You

• You have a degree in BS, MS.c or Ph.D with 1+ years of relevant experience
• Strong proficiency in Python or similar languages. Familiarity with c++.
• Technical excellence: Develop with a high standard for performance, scalability, and code quality.
• Domain experience: Experience working with ML pipelines; ability to understand and design complex distributed systems
• Independence and productivity: Ability and willingness to dive into unfamiliar territory, learn fast, and improve complex systems.

Bonus Points

• Strong proficiency in C++ or other high-performance low-level languages
• Experience working with large-scale distributed systems
• Experience with system & framework design
• Experience with data workflow orchestration platforms
• Experience with ML compilers

At Nuro, your base pay is one part of your total compensation package. For this position, the reasonably expected base pay range is between $160,360 and $240,540 for the level at which this job has been scoped. Your base pay will depend on several factors, including your experience, qualifications, education, location, and skills. In the event that you are considered for a different level, a higher or lower pay range would apply. This position is also eligible for an annual performance bonus, equity, and a competitive benefits package.

At Nuro, we celebrate differences and are committed to a diverse workplace that fosters inclusion and psychological safety for all employees. Nuro is proud to be an equal opportunity employer and expressly prohibits any form of workplace discrimination based on race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, genetic information, disability, veteran status, or any other legally protected characteristics.