Software Engineer, On-Device Machine Learning

Google Inc.; Sunnyvale (CA); On-site; USD 174,000 - 253,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

Google Sunnyvale, CA, USA is seeking a Software Engineer for On-Device Machine Learning to design, implement, and optimize ML solutions that run on edge devices across Android, Chrome, iOS, and desktop platforms.

You will work with LiteRT, Gemini Nano, and Gemma models, enabling hardware acceleration and on-device inference improvements while collaborating with cross-functional teams.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 2 years of experienced in mobile development.
• 5 years of experience with software development in one or more programming languages.
• 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
• 2 years of experience developing compilers.

Responsibilities

• Collaborate with peers and stakeholders through design and code reviews to ensure best practices among available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
• Design and implement solutions in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise in a chosen field.
• Develop LiteRT, Google’s on-device AI framework for first- and third-party use, enabling state-of-the-art hardware acceleration and use cases on edge platforms.
• Enable on-device deployment of key models, such as Gemini Nano and Gemma, across various accelerators (GPU / Pixel TPU / NPUs / CPU) on Android, Chrome, iOS, desktop, and more.
• Improve performance of on-device model inference via optimizations in the model representation, on-device runtime, and kernel implementation.

Skills

Software development

ML infrastructure

Developing compilers

Mobile development

Education

Bachelor’s degree or equivalent

Tools

PyTorch

JAX

TensorFlow

TensorFlow Lite

Core ML

SNPE/QNN

ExecuTorch

Job description

Software Engineer, On-Device Machine Learning

Google Sunnyvale, CA, USA

Required Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in one or more programming languages.
• 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
• 2 years of experience developing compilers.
• Relevant work experience in mobile development.

Preferred Qualifications

• Experience in ML frameworks (e.g., PyTorch, JAX, TensorFlow).
• Experience with on-device ML SDKs/tooling (e.g., TensorFlow Lite, ExecuTorch, Core ML, SNPE/QNN).
• Strong understanding of Generative AI model architectures and their optimization for on-device execution.
• Excellent communication and collaboration skills.
• Passion for innovation and a strong desire to push the boundaries of what is possible with on-device ML.

Responsibilities

• Collaborate with peers and stakeholders through design and code reviews to ensure best practices among available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
• Design and implement solutions in one or more specialized ML areas, leverage ML infrastructure, and demonstrate expertise in a chosen field.
• Develop LiteRT, Google’s on-device AI framework for first- and third-party use, enabling state-of-the-art hardware acceleration and use cases on edge platforms.
• Enable on-device deployment of key models, such as Gemini Nano and Gemma, across various accelerators (GPU / Pixel TPU / NPUs / CPU) on Android, Chrome, iOS, desktop, and more.
• Improve performance of on-device model inference via optimizations in the model representation, on-device runtime, and kernel implementation.

US: $174,000 - $253,000 (USD) + 15% bonus target + equity + benefits

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity or expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents‑to‑be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google’s EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.