Senior AI/ML Software Engineer - LLM Pipelines

Google; Austin (TX); On-site; USD 147,000 - 210,000; Full time

Benefits offered by this job

Health, dental, vision, life, and 2nd-

Disability insurance

Retirement Benefits: 401(k) with match

Paid Time Off: 20 days per year

Sick Time: 40 hours/year

Maternity Leave: 28-30 weeks

Baby Bonding Leave: 18 weeks

Holidays: 13 paid days per year

Job summary

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search.

We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 2 years of experience with Large Language Models (LLMs) and Generative AI concepts (e.g., prompt engineering, retrieval-augmented generation (RAG)).
• 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
• 1 year of experience with end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging).

Responsibilities

• Write clean, testable, and resilient production code in Python, C++, or Java, implement automated integration, stress, and regression testing for LLM pipelines, proactively identify and pay down technical debt.
• Deliver complete, robust software components and services that productionalize Data Science prototypes, LLM pipelines, and AI workflows with minimal supervision.
• Implement orchestration logic, context window management, structured output parsing, and API integrations connecting foundational LLMs to backend systems and frontend interfaces.
• Build and maintain automated evaluation pipelines (LLM-as-a-judge, benchmark suites, deterministic unit tests) to monitor hallucination rates, output quality, and inference latency.
• Partner effectively with Data Scientists, Web Solutions Engineers, and Technical Program Managers to clarify requirements, manage component dependencies, and unblock execution.

Skills

LLM concepts

Software development

Machine learning

Education

Bachelor's degree or equivalent

Tools

Python

C++

Java

Job description

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search.

We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language