Multimodal AI XR Engineer | On-Device, Edge AI, Equity

Google LLC; New York (NY); On-site; USD 147,000 - 210,000; Full time

Job summary

Google's XR team seeks a software engineer to advance multimodal and conversational AI for next-gen wearables. You will develop on-device and hybrid models for XR glasses/headsets, leveraging prompts, few-shot learning, and post-training techniques within power and latency limits.

You will evaluate performance, design hybrid architectures, and collaborate with researchers to drive a practical AI roadmap and product launches worldwide. English proficiency is required for all roles.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 2 years of software development experience or 1 year with an advanced degree.
• 1 year of experience with speech/audio, reinforcement learning, ML infrastructure, or related ML field.
• 1 year of experience with ML frameworks such as JAX, TensorFlow, or PyTorch.

Responsibilities

• Lead the development and optimization of on-device and hybrid multimodal models for XR devices.
• Create comprehensive evaluation plans from dataset development to KPI definitions.
• Identify, implement, and ship the latest modeling innovations for hybrid architectures.
• Prove out concepts for on-device AI features via rapid prototyping and teamwork with XR product teams.
• Collaborate with research scientists, engineers, and product teams to drive the technical roadmap and publish findings.

Skills

Programming languages

Speech/Audio ML

Reinforcement learning

ML infrastructure

Multimodal learning

Prompt engineering

Few-shot learning

On-device training/deployment

Education

Bachelor's degree or equivalent practical experience

Master's degree or PhD

Tools

JAX

TensorFlow

PyTorch

Job description

Google's XR team seeks a software engineer to advance multimodal and conversational AI for next-gen wearables. You will develop on-device and hybrid models for XR glasses/headsets, leveraging prompts, few-shot learning, and post-training techniques within power and latency limits.

You will evaluate performance, design hybrid architectures, and collaborate with researchers to drive a practical AI roadmap and product launches worldwide. English proficiency is required for all roles.