Senior Software Engineer, AI/ML Search Infrastructure

Google; Mountain View (CA); On-site; USD 174,000 - 252,000; Full time

Benefits offered by this job

Equity

Bonus potential

Benefits

Job summary

Google is seeking software engineers to advance next-generation search and GenAI infrastructure. You will work on scalable systems spanning information retrieval, distributed computing, and data storage, applying ML, AI, and NLP techniques to deliver impact at planetary scale.

Join a team that values versatility, leadership and curiosity, with opportunities to switch projects as the company grows. The role emphasizes collaboration across full-stack engineering and product teams.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 5 years of experience with software development in C++ and Java
• Experience in domains related to information retrieval, search infrastructure, ranking systems, data quality, or signal extraction for content evaluation.
• Experience with large-scale data analysis, building data pipelines (e.g., Flume), and applying statistical methods to solve problems.

Responsibilities

• Design and implement secure, scalable data ingestion pipelines that enforce strict access controls and copyright compliance for premium, rights-protected content across all GenAI serving surfaces.
• Optimize large-scale Retrieval-Augmented Generation (RAG) infrastructure, focusing on improving the latency, relevance, and computational efficiency of embedding generation and vector searches.
• Drive the end-to-end technical integration of the Expert Intelligence platform with flagship Google GenAI products (e.g., NotebookLM, Gemini Deep Research), utilizing Spanner to ensure low-latency and highly available serving.
• Develop and scale distributed batch and streaming processing pipelines (using tools like Flume) to continuously ingest, clean, and index terabytes of unstructured and semi-structured external publisher data.
• Provide technical leadership and mentorship to other engineers within a rapidly growing organization, guiding system architecture decisions and establishing best practices for LLM-backed infrastructure.

Skills

C++

Java

Information retrieval

Search infrastructure

Ranking systems

Data quality

Signal extraction

Data analysis

Data pipelines

Flume

Education

Bachelor's degree or equivalent

Master's degree or PhD in CS or related field

Tools

Flume

Spanner

Job description

Google is seeking software engineers to advance next-generation search and GenAI infrastructure. You will work on scalable systems spanning information retrieval, distributed computing, and data storage, applying ML, AI, and NLP techniques to deliver impact at planetary scale.

Join a team that values versatility, leadership and curiosity, with opportunities to switch projects as the company grows. The role emphasizes collaboration across full-stack engineering and product teams.