AI Infrastructure Engineer, Core — Build Scalable AI Pipelines

Google LLC; Austin, New York (TX, NY); On-site; USD 151,000 - 252,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

Google Austin, TX, USA is seeking a Software Engineer for AI Infrastructure in the Core team. You will design, implement, and deploy production-grade Java software across large-scale AI workflows, contributing to core infrastructure that underpins Google’s flagship products.

The role requires 5 years in Java software development, 3 years in testing/maintenance/launching software, plus 1 year in GenAI or related ML concepts, and experience in machine learning infrastructure.

Qualifications

• 5 years of experience with software development in Java.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• 1 year of experience with GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).

Responsibilities

• Design, write, and deploy production-grade code for multi-agent workflows, tool-use orchestration engines, and dynamic decision-making pipelines.
• Deploy AI frameworks and tools, to enable velocity in product development and scalability of agentic applications that require high-precision and safe execution under complex real-world conditions.
• Build robust, high-throughput model serving pipelines and real-time execution environments optimized for latency, reliability, and scale.
• Integrate continuous, data-driven feedback loops into AI development methodologies. Construct automated testing, continuous evaluation, and observability frameworks to assess agent coverage, monitor regressions, and safeguard product quality across end-to-end workflows.
• Adopt and integrate distributed tracing, data lineage architectures, and telemetry (e.g., OpenTelemetry) into high-volume generative AI data pipelines.

Skills

Java

Software dev

GenAI

ML infrastructure

Education

Bachelor's degree

Job description

Google Austin, TX, USA is seeking a Software Engineer for AI Infrastructure in the Core team. You will design, implement, and deploy production-grade Java software across large-scale AI workflows, contributing to core infrastructure that underpins Google’s flagship products.

The role requires 5 years in Java software development, 3 years in testing/maintenance/launching software, plus 1 year in GenAI or related ML concepts, and experience in machine learning infrastructure.