Tech Lead, ML Inference Performance

Google LLC; Greater London; On-site; GBP 120,000 - 180,000; Full time

Job summary

DeepMind in London seeks a Tech Lead for Gemini Inference Performance to guide a team of performance engineers and drive optimization across ML frameworks and hardware accelerators.

You will leverage transformer and Mixture-of-Experts concepts to improve latency and memory efficiency while collaborating with research teams on deployment trade-offs. A strong leadership track record is essential.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 8+ years of software development.
• 5+ years in people management/supervision/team leadership.
• 5+ years in a technical leadership role and overseeing projects.
• Master’s degree or PhD in Engineering, CS, or related field preferred.
• 5+ years in a complex, matrixed organization.

Responsibilities

• Set the technical roadmap for a team of performance engineers and drive prioritization of optimization opportunities.
• Identify and eliminate performance bottlenecks across ML frameworks, compilers, kernels, and serving infrastructure on hardware accelerators.
• Apply first-principles understanding of Transformer and Mixture-of-Experts components to optimize execution and memory footprint.
• Collaborate with research teams early to evaluate inference implications on latency and serving costs.
• Guide development of custom kernels and serving optimizations and perform deep performance profiling.

Skills

Software development

People management

Technical leadership

Education

Bachelor's degree

Master's/PhD preferred

Tools

Transformer models

Mixture of Experts

Hardware profiling

Job description

DeepMind in London seeks a Tech Lead for Gemini Inference Performance to guide a team of performance engineers and drive optimization across ML frameworks and hardware accelerators.

You will leverage transformer and Mixture-of-Experts concepts to improve latency and memory efficiency while collaborating with research teams on deployment trade-offs. A strong leadership track record is essential.