On-Device ML Engineer: Edge AI & LiteRT

Google Inc.; Sunnyvale (CA); On-site; USD 174,000 - 253,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

Google Sunnyvale, CA, USA is seeking a Software Engineer for On-Device Machine Learning to design, implement, and optimize ML solutions that run on edge devices across Android, Chrome, iOS, and desktop platforms.

You will work with LiteRT, Gemini Nano, and Gemma models, enabling hardware acceleration and on-device inference improvements while collaborating with cross-functional teams.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 2 years of experienced in mobile development.
• 5 years of experience with software development in one or more programming languages.
• 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
• 2 years of experience developing compilers.

Responsibilities

• Collaborate with peers and stakeholders through design and code reviews to ensure best practices among available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
• Design and implement solutions in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise in a chosen field.
• Develop LiteRT, Google’s on-device AI framework for first- and third-party use, enabling state-of-the-art hardware acceleration and use cases on edge platforms.
• Enable on-device deployment of key models, such as Gemini Nano and Gemma, across various accelerators (GPU / Pixel TPU / NPUs / CPU) on Android, Chrome, iOS, desktop, and more.
• Improve performance of on-device model inference via optimizations in the model representation, on-device runtime, and kernel implementation.

Skills

Software development

ML infrastructure

Developing compilers

Mobile development

Education

Bachelor’s degree or equivalent

Tools

PyTorch

JAX

TensorFlow

TensorFlow Lite

Core ML

SNPE/QNN

ExecuTorch

Job description

Google Sunnyvale, CA, USA is seeking a Software Engineer for On-Device Machine Learning to design, implement, and optimize ML solutions that run on edge devices across Android, Chrome, iOS, and desktop platforms.

You will work with LiteRT, Gemini Nano, and Gemma models, enabling hardware acceleration and on-device inference improvements while collaborating with cross-functional teams.