Senior Software Engineer, Search AI Infra

Google Inc

Bengaluru

On-site

INR 2,800,000 - 4,600,000

Full time

45 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Google is seeking a Senior Software Engineer for Search AI Infra in Bengaluru to design, build, and operate large-scale distributed systems with a strong focus on scalability, reliability, and AI integration. You will work across Gemini revisions and TPU-based serving to deliver high-impact AI capabilities at global scale.

Join Google's Search AI team to collaborate with researchers, product teams, and leadership, driving innovation and responsible deployment while shaping the future of AI in

Qualifications

  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages.
  • Experience designing, building, and operating large-scale distributed systems with focus on scalability, fault tolerance, and reliability.
  • Experience with AI, Generative AI, data processing technologies, performance, or scalability optimizations.
  • Experience working with data structures or Machine Learning algorithms.

Responsibilities

  • Make models fast and cheap by selecting decoding, caching, sharding, and quantization bets with tests.
  • Understand Gemini revisions and design serving topology per TPU costs.
  • Build guardrails for fast, safe deployment: checks, pre-submits, monitor, rollback.
  • Qualify new checkpoints, shape evaluation and autorater strategy, explain slowdowns.
  • Write design documentation and participate in design and code reviews.

Skills

Software development
Distributed systems
AI / Generative AI
Data structures / ML algorithms

Education

Bachelor's degree or equivalent

Job description

Senior Software Engineer, Search AI Infra

Share Senior Software Engineer, Search AI Infra

X In most instances, this position requires in-person interviews as part of the hiring process.

Required qualifications
  • Bachelor’s degree or equivalent practical experience.
  • 5 years of experience with software development in one or more programming languages.
  • Experience designing, building, and operating large-scale distributed systems, with a focus on scalability, fault tolerance, and reliability.
  • Experience with AI, Generative AI, data processing technologies, performance, or scalability optimizations.
  • Experience working with data structures or Machine Learning algorithms.
Preferred qualifications:
  • Master’s degree or PhD in Computer Science or a related technical field.
  • 3 years of experience with machine learning model serving, LLM inference, or machine learning evaluation systems.
  • Experience optimizing performance or efficiency on hardware accelerators (TPUs or GPUs) through profiling, sharding, batching, caching, or quantization.
  • Experience leading technical projects across teams from design through launch.
  • Experience with distributed systems and safe production rollout practices.
  • Ability to communicate with researchers, product teams, and leadership to make decisions.
About the job

Google’s software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We’re looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google’s needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Join Google Search AI and work at the intersection of industry leading
global scale. We apply breakthrough research, leveraging models like Gemini, to launch high-impact products that help billions ask any question and get things done. If you want to drive the future of AI in Search and work with world-class experts to deliver tangible, global impact and continuous innovation, this is the place.

Responsibilities
  • Make models fast and cheap by picking speculative decoding, prefix caching, sharding, and quantization bets, proving them with load tests and live experiments, and landing them.
  • Get to know every new Gemini revision better than its release notes do, analyze what changed in its architecture, behaviour, and cost to turn that into a serving topology that gets the most quality out of every TPU chip.
  • Build the guardrails that let us move fast without breaking Search: configure checks, pre-submits, monitor and fast rollback, fix the root cause, not just the alert.
  • Qualify new checkpoints, shape evaluation and autorater strategy, and explain why the new revision is suddenly slower, and what steps needs to be taken to improve it.
  • Write the design documentation people read, and raise the bar in design and code reviews.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google’s EEO Policy , Know your rights: workplace discrimination is illegal , Belonging at Google , and How we hire .

Google is a global company and, in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Software Engineer, Search ML Infrastructure
Staff Software Engineer, Search ML Infrastructure

Google LLC • Bengaluru

On-site
INR 3,800,000 - 7,000,000
Staff Software Engineer, Search Production Intelligence
Staff Software Engineer, Search Production Intelligence

Google • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Staff Software Engineer, Search Intelligence
Staff Software Engineer, Search Intelligence

Google LLC • Bengaluru

On-site
INR 4,000,000 - 6,500,000
Software Engineering Manager, Search
Software Engineering Manager, Search

Google LLC • Bengaluru

On-site
INR 2,600,000 - 3,800,000
Software Engineer, Security, Privacy, Detection
Software Engineer, Security, Privacy, Detection

Google LLC • Hyderabad

On-site
INR 400,000 - 800,000
Tech Lead Manager, Data Protection Understanding, AI Acceleration, Core
Tech Lead Manager, Data Protection Understanding, AI Acceleration, Core

Google LLC • Bengaluru

On-site
INR 4,200,000 - 5,600,000
Senior Software Engineer, Google Cloud
Senior Software Engineer, Google Cloud

Google LLC • Bengaluru

On-site
INR 3,500,000 - 8,000,000
Staff Software Engineer, Google Global Infrastructure
Staff Software Engineer, Google Global Infrastructure

Google • Bengaluru

On-site
INR 6,000,000 - 9,000,000
Software Engineering Manager, AI/ML Infrastructure and Performance Engineering
Software Engineering Manager, AI/ML Infrastructure and Performance Engineering

Google • Bengaluru

On-site
INR 3,500,000 - 5,500,000
Staff Software Engineer, Multimodal Search
Staff Software Engineer, Multimodal Search

Google LLC • Bengaluru

On-site
INR 3,500,000 - 7,000,000