Senior On-Device AI & Voice LLM Architect

Google LLC; San Jose (CA); On-site; USD 307,000 - 427,000; Full time

Benefits offered by this job

Equity

Bonus target 30%

Benefits

Job summary

Google LLC invites an experienced Senior Principal On-Device and Voice LLM Architect to shape the future of XR with on-device intelligence. You will own architectural vision for LLM integration and voice interfaces across wearables, bridging silicon capabilities with AI services for responsive, private experiences.

The role sits within the Android XR team, collaborating with cross-functional partners to drive long-term spatial intelligence roadmaps, optimize edge performance, and mentor

Qualifications

• Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.
• 15 years of software development experience, with a focus on system architecture, machine learning, or mobile platforms.
• Experience leading large-scale technical projects from conception to launch, managing multiple stakeholders without direct authority.
• Experience architecting systems for mobile or embedded devices.

Responsibilities

• Lead the end-to-end technical architecture for on-device LLM integration and voice processing pipelines within the Android XR ecosystem.
• Drive hardware-software co-design efforts to optimize model performance for constrained Edge-AI environments, focusing on latency, power, and memory efficiency.
• Collaborate cross-functionally with Silicon, Android OS, and Google Research teams to define the long-term roadmap for spatial intelligence.
• Mentor senior technical leads and staff engineers, fostering a culture of technical excellence and innovative problem-solving across the organization.
• Influence the broader industry by representing Google in technical standards and partnerships related to on-device AI and XR.

Skills

System architecture

Leadership

Mobile/embedded

Large-scale projects

Education

Bachelor’s degree in Computer Science or related field

Tools

C++

Rust

TensorFlow

PyTorch

JAX

Job description

Google LLC invites an experienced Senior Principal On-Device and Voice LLM Architect to shape the future of XR with on-device intelligence. You will own architectural vision for LLM integration and voice interfaces across wearables, bridging silicon capabilities with AI services for responsive, private experiences.

The role sits within the Android XR team, collaborating with cross-functional partners to drive long-term spatial intelligence roadmaps, optimize edge performance, and mentor