Senior AI/ML Software Engineer - LLM Pipelines

Google; Chicago (IL); On-site; USD 147,000 - 210,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

401(k) with company match

Paid vacation

Sick time

Maternity leave

Baby bonding leave

Holidays

Job summary

Google's Chicago team is seeking a Software Engineer III, AI/ML to advance large-scale AI initiatives. You will write production-grade code in Python, C++, or Java and help deploy AI pipelines that power Google's products.

This role values experience with LLMs, prompt engineering, and end-to-end ML. You will collaborate across Data Scientists and PMs, contribute to robust systems, and participate in in-person interviews in Chicago or other locations.

Qualifications

• Bachelor’s degree or equivalent practical experience.
• 2 years of experience with Large Language Models (LLMs) and Generative AI concepts (e.g., prompt engineering, retrieval-augmented generation (RAG).
• 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree.
• 1 year of experience with end-to-end Machine Learning (e.g., model deployment, model evaluation, data processing, debugging).

Responsibilities

• Write clean, testable, and resilient production code in Python, C++, or Java, implement automated integration, stress, and regression testing for Large Language Model (LLM) pipelines, proactively identify and pay down technical debt.
• Deliver complete, robust software components and services that productionalize Data Science prototypes, LLM pipelines, and AI workflows with minimal supervision.
• Implement orchestration logic, context window management, structured output parsing, and API integrations connecting foundational LLMs to backend systems and frontend interfaces.
• Build and maintain automated evaluation pipelines (LLM-as-a-judge, benchmark suites, deterministic unit tests) to monitor hallucination rates, output quality, and inference latency.
• Partner effectively with Data Scientists, Web Solutions Engineers, and Technical Program Managers to clarify requirements, manage component dependencies, and unblock execution.

Skills

LLMs experience

Generative AI concepts

Python

C++

Java

End-to-end ML

Education

Bachelor's degree or equivalent practical experience

Tools

Python

C++

Java

Job description

Google's Chicago team is seeking a Software Engineer III, AI/ML to advance large-scale AI initiatives. You will write production-grade code in Python, C++, or Java and help deploy AI pipelines that power Google's products.

This role values experience with LLMs, prompt engineering, and end-to-end ML. You will collaborate across Data Scientists and PMs, contribute to robust systems, and participate in in-person interviews in Chicago or other locations.