Staff On-Device ML Software Engineer

Google; Mountain View (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google is seeking a senior software engineer to advance on-device machine learning for mobile and embedded devices. You will own end-to-end model development, from research prototypes to production deployments across hundreds of millions of devices, integrating training pipelines with C++ and the camera stack.

The role focuses on optimizing models for on-device accelerators, quantization, and hardware-aware design, while collaborating with Tensor teams to deliver scalable ML systems.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 8 years of experience with software design and architecture.
• Experience with C, C++, machine learning, and embedded systems.
• Experience with machine learning algorithms.
• Experience with machine learning architecture.
• Experience with machine learning research.

Responsibilities

• Design and implement the real-time on-device machine learning foundation that turns raw camera and sensor input into structured signals driving immediate application behavior.
• Drive the optimization of outlook models for NPU, GPU, and DSP execution, including quantization, hardware-aware architecture design, and custom kernel development, in partnership with the Tensor silicon and compiler teams.
• Own models end-to-end, from prototype through deployment on hundreds of millions of devices - training pipelines in JAX and TensorFlow, C++ integration into the camera pipeline, and long-term maintainability.
• Partner with product, UX, software, and hardware teams to define the requirements for next-generation interactive features, and translate roadmap goals into designs achievable within device constraints.
• Establish best practices for machine learning development, deployment, and evaluation. Define how model quality is measured; and contribute to the long-term technology roadmap.

Skills

Software design

Architecture

Machine learning

Embedded systems

Education

Bachelor’s degree or equivalent

Master’s or PhD in Engineering/CS

Tools

C

C++

JAX/TensorFlow

Job description

Google is seeking a senior software engineer to advance on-device machine learning for mobile and embedded devices. You will own end-to-end model development, from research prototypes to production deployments across hundreds of millions of devices, integrating training pipelines with C++ and the camera stack.

The role focuses on optimizing models for on-device accelerators, quantization, and hardware-aware design, while collaborating with Tensor teams to deliver scalable ML systems.