Senior AI/ML Engineer — LLM Pipelines & Production

Google LLC; Austin (TX); On-site; USD 147,000 - 210,000; Full time

Benefits offered by this job

Health insurance

401(k) with company match

Paid Time Off

Holidays

Competitive compensation

Job summary

Google LLC is seeking software engineers to build scalable AI-driven solutions within the Global Affairs framework, focusing on LLM pipelines, orchestration, and production-grade data processing. You will collaborate with data scientists and engineers to deliver robust AI-backed software across Google products.

The role emphasizes cross-functional impact, high-scale systems, and a strong focus on reliability, security, and performance in a fast-paced environment.

Qualifications

• 2 years of experience with Large Language Models (LLMs) and Generative AI concepts (e.g., prompt engineering, retrieval-augmented generation).
• 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
• 1 year of experience with end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging).

Responsibilities

• Write clean, testable, and resilient production code in Python, C++, or Java for LLM pipelines and automate testing.
• Deliver robust software components that productionalize Data Science prototypes, LLM pipelines, and AI workflows.
• Implement orchestration logic, context window management, and API integrations between LLMs and backend/frontend systems.
• Build automated evaluation pipelines to monitor hallucination rates, output quality, and latency.
• Collaborate with Data Scientists, Web Solutions Engineers, and Technical Program Managers to clarify requirements and unblock work.

Skills

Python

C++

Java

LLM concepts

Machine Learning

Education

Bachelor's degree or equivalent practical experience

Tools

LLM pipelines

Job description

Google LLC is seeking software engineers to build scalable AI-driven solutions within the Global Affairs framework, focusing on LLM pipelines, orchestration, and production-grade data processing. You will collaborate with data scientists and engineers to deliver robust AI-backed software across Google products.

The role emphasizes cross-functional impact, high-scale systems, and a strong focus on reliability, security, and performance in a fast-paced environment.