GenAI Core Senior Engineer – ML/LLM Systems

Google; Ionia (NY); On-site; USD 180,000 - 252,000; Full time

Job summary

Google in New York, NY is seeking a Senior Software Engineer for AI/ML GenAI on the Core team to design, deploy, and optimize GenAI solutions at scale. You will contribute to foundational infrastructure and work across product areas to push technology forward.

The role focuses on building GenAI capabilities, integrating ML deployment and evaluation, and collaborating with teams to ship reliable systems. 5 years of Python/C++ and ML infra experience are required.

Qualifications

• Bachelor's degree or equivalent practical experience.
• 5 years of experience programming in Python or C++.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• 3 years of experience with ML infrastructure (e.g., model deployment, model evaluation, optimization, data processing, debugging).
• 1 year of experience with state of the art GenAI techniques (e.g., LLMs, Multi-Modal, Large Vision Models) or with GenAI-related concepts (language modeling, computer vision).

Responsibilities

• Write and test product or system development code.
• Collaborate with peers and stakeholders through design and code reviews to ensure best practices amongst available technologies (e.g., style guidelines, checking code in, accuracy, testability, and efficiency).
• Contribute to existing documentation or educational content and adapt content based on product/program updates and user feedback.
• Triage product or system issues and debug/track/resolve by analyzing the sources of issues and the impact on hardware, network, or service operations and quality.
• Design and implement GenAI solutions, leverage ML infrastructure, and evaluate tradeoffs between different techniques and their application domains.

Skills

Python

C++

Software testing

Software design

GenAI concepts

ML infrastructure

Education

Bachelor's degree

Master's or PhD preferred

Tools

ML deployment

Model evaluation

Data processing

Debugging

Job description

Google in New York, NY is seeking a Senior Software Engineer for AI/ML GenAI on the Core team to design, deploy, and optimize GenAI solutions at scale. You will contribute to foundational infrastructure and work across product areas to push technology forward.

The role focuses on building GenAI capabilities, integrating ML deployment and evaluation, and collaborating with teams to ship reliable systems. 5 years of Python/C++ and ML infra experience are required.