Software Engineer, AI Infrastructure, Core

Google LLC; Ionia (NY); On-site; USD 174,000 - 252,000; Full time

Job summary

Google LLC is seeking a Software Engineer, AI Infrastructure, Core, to build production-grade code for multi-agent workflows and AI frameworks in a high-scale environment. The role focuses on deploying robust AI tooling, scalable model serving, and automated testing while advancing end-to-end AI pipelines.

We value strong Java development experience and a background in GenAI techniques, ML infrastructure, and distributed systems, with opportunities to lead and collaborate across teams in Austin,

Qualifications

• 5 years of software development experience in Java.
• 3 years testing, maintaining, or launching software products with 1 year of design/architecture experience.
• 1 year of experience with GenAI techniques (LLMs, multi-modal) or GenAI concepts.
• Experience in machine learning infrastructure.

Responsibilities

• Design, write, and deploy production-grade code for multi-agent workflows and orchestration engines.
• Deploy AI frameworks to enable velocity in product development and scalable AI applications.
• Build high-throughput model serving pipelines and real-time execution environments optimized for latency and scale.
• Integrate continuous, data-driven feedback loops into AI development methodologies with automated testing and observability.
• Adopt distributed tracing, data lineage, and telemetry into high-volume AI data pipelines.

Skills

Java development

GenAI techniques

ML infrastructure

Software testing/QA

Distributed systems

Education

Bachelor's degree or equivalent practical experience

Master's degree or PhD in CS or related field

Job description

Software Engineer, AI Infrastructure, Core

Location: Austin, TX, USA; New York, NY, USA

Experience Level: Mid

Overview

Google's software engineers develop the next-generation technologies that change how billions of users connect, explore, and interact with information and one another. Our products need to handle information at massive scale, and extend well beyond web search. We're looking for engineers who bring fresh ideas from all areas, including information retrieval, distributed computing, large-scale system design, networking and data storage, security, artificial intelligence, natural language processing, UI design, and mobile; the list goes on and is growing every day. As a software engineer, you will work on a specific project critical to Google's needs with opportunities to switch teams and projects as you and our fast-paced business grow and evolve. We need our engineers to be versatile, display leadership qualities, and be enthusiastic to take on new problems across the full-stack as we continue to push technology forward.

Minimum Qualifications

• Bachelor's degree or equivalent practical experience.
• 5 years of experience with software development in Java.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• 1 year of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).
• Experience in machine learning infrastructure.

Preferred Qualifications

• Master's degree or PhD in Computer Science, or a related technical field.
• 1 year experience in machine learning, generative AI and AI algorithms.
• 1 year of experience in a technical leadership role.

Responsibilities

• Design, write, and deploy production-grade code for multi-agent workflows, tool-use orchestration engines, and dynamic decision-making pipelines.
• Deploy AI frameworks and tools, to enable velocity in product development and scalability of agentic applications that require high-precision and safe execution under complex real-world conditions.
• Build robust, high-throughput model serving pipelines and real-time execution environments optimized for latency, reliability, and scale.
• Integrate continuous, data-driven feedback loops into AI development methodologies. Construct automated testing, continuous evaluation, and observability frameworks to assess agent coverage, monitor regressions, and safeguard product quality across end-to-end workflows.
• Adopt and integrate distributed tracing, data lineage architectures, and telemetry (e.g., OpenTelemetry) into high-volume generative AI data pipelines.

Compensation

• US: $174,000 - $252,000 (USD) + 15% bonus target + equity + benefits

Learn more about benefits at Google.

Additional Information

Information collected and processed as part of your Google Careers profile and any job applications you choose to submit is subject to Google's Applicant and Candidate Privacy Policy.

Google is proud to be an equal opportunity and affirmative action employer. We are committed to building a workforce that is representative of the users we serve, creating a culture of belonging, and providing an equal employment opportunity regardless of race, creed, color, religion, gender, sexual orientation, gender identity/expression, national origin, disability, age, genetic information, veteran status, marital status, pregnancy or related condition (including breastfeeding), expecting or parents-to-be, criminal histories consistent with legal requirements, or any other basis protected by law. See also Google's EEO Policy, Know your rights: workplace discrimination is illegal, Belonging at Google, and How we hire.

If you have a need that requires accommodation, please let us know by completing our Accommodations for Applicants form.

Google is a global company, and in order to facilitate efficient collaboration and communication globally, English proficiency is a requirement for all roles unless stated otherwise in the job posting.

To all recruitment agencies: Google does not accept agency resumes. Please do not forward resumes to our jobs alias, Google employees, or any other organization location. Google is not responsible for any fees related to unsolicited resumes.

Equity is granted exclusively and discretionarily by Alphabet Inc. on the basis of an agreement concluded between you and Alphabet Inc. Alphabet Inc. is your sole contractual partner with respect to equity grants. GSU grants are not guaranteed, are discretionary, are subject to approval by the Alphabet Inc. board of directors or its delegate, the terms of the relevant Alphabet Inc. stock plan, and your grant agreement. They have no impact on statutory payments. Current or past grants do not confer an acquired right.