Senior On-Device ML Engineer – Edge Inference

Google LLC; Sunnyvale (CA); On-site; USD 174,000 - 252,000; Full time

Job summary

Google Sunnyvale, CA is seeking a Senior Software Engineer for On-Device Machine Learning to advance LiteRT and on-device AI capabilities. This role focuses on end-to-end ML, model deployment, and hardware-accelerated inference across edge devices.

Successful candidates will have deep experience in ML frameworks, data processing, and system design, with strong coding and testing skills and in-person interview readiness.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of software development experience.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• 3 years of experience with one or more of: Speech/Audio, reinforcement learning, ML infrastructure, or another ML field.
• 3 years of experience with end-to-end Machine Learning (model deployment, evaluation, data processing, debugging).

Responsibilities

• Write and test product or system development code.
• Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
• Develop LiteRT, Google's on-device AI framework for 1P and 3P, enabling SOTA hardware acceleration and use cases on edge platforms
• Enable on-device deployment of key models, such as Gemini Nano and Gemma, across various accelerators (GPU / Pixel TPU / NPUs / CPU) on Android, Chrome, and more.
• Improve performance of on-device model inference via optimizations in the model conversion, on-device runtime and kernel implementation.

Skills

Software development

Software testing

Software design

Speech/Audio

Reinforcement learning

ML infrastructure

End-to-end ML

Education

Bachelor's degree or equivalent practical experience

Master's degree or PhD in Computer Science or related field

Tools

TensorFlow Lite

ExecuTorch

Core ML

SNPE/QNN

PyTorch

JAX

TensorFlow

Job description

Google Sunnyvale, CA is seeking a Senior Software Engineer for On-Device Machine Learning to advance LiteRT and on-device AI capabilities. This role focuses on end-to-end ML, model deployment, and hardware-accelerated inference across edge devices.

Successful candidates will have deep experience in ML frameworks, data processing, and system design, with strong coding and testing skills and in-person interview readiness.