Senior On-Device ML Engineer - LiteRT & Edge AI

Google LLC; Sunnyvale (CA); On-site; USD 174,000 - 252,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

Google Sunnyvale, CA, USA is seeking a Senior Software Engineer for On-Device Machine Learning. You will help build LiteRT, Google's on-device AI framework, optimize model deployment, and enable hardware-accelerated inference on edge devices.

The role demands deep software development experience, ML knowledge, and the ability to design end-to-end systems. In-person interviews are common, and compensation includes base salary, bonus target, equity, and benefits.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• 3 years of experience with one or more of the following: Speech/audio, RL, ML infrastructure, or related ML field.
• 3 years of experience with end-to-end Machine Learning (model deployment, evaluation, data processing, debugging).

Responsibilities

• Write and test product or system development code.
• Triage product or system issues and debug/track/resolve by analyzing sources and impact on hardware, network, or service operations and quality.
• Develop LiteRT, Google's on-device AI framework for 1P and 3P, enabling SOTA hardware acceleration and use cases on edge platforms.
• Enable on-device deployment of models such as Gemini Nano and Gemma across accelerators (GPU / Pixel TPU / NPUs / CPU) on Android, Chrome, and more.
• Improve performance of on-device model inference via optimizations in the model conversion, on-device runtime and kernel implementation.

Skills

Software development

Testing and launching software

End-to-end ML

On-device ML

ML infrastructure knowledge

Education

Bachelor’s degree or equivalent practical experience

Master’s or PhD preferred

Job description

Google Sunnyvale, CA, USA is seeking a Senior Software Engineer for On-Device Machine Learning. You will help build LiteRT, Google's on-device AI framework, optimize model deployment, and enable hardware-accelerated inference on edge devices.

The role demands deep software development experience, ML knowledge, and the ability to design end-to-end systems. In-person interviews are common, and compensation includes base salary, bonus target, equity, and benefits.