Lead AI/ML Infrastructure Engineer

Socket.dev; Mountain View (CA); On-site; USD 207,000 - 300,000; Full time

Job summary

Google is seeking a software engineer to lead architecting and scaling next-generation infrastructure powering AI/ML applications across Ads, YouTube, and GenAI research. You will drive high-throughput systems for creative generation and optimization, while aligning with business goals and mentoring engineers.

You will design and deploy scalable data engines, generation pipelines, and orchestration frameworks, balancing performance with reliability in a distributed environment.

Qualifications

• Bachelor’s degree in Computer Science, a related technical field, or equivalent practical experience.
• 8 years of experience in software development.
• 5 years of experience testing, and launching software products.
• 5 years of experience building and developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage, or hardware architecture.
• 3 years of experience with software design and architecture.
• Experience designing or deploying machine learning (ML) infrastructure or platforms.

Responsibilities

• Serve as the technical leader responsible for architecting, scaling, and steering the next-generation infrastructure that powers our AI/ML applications.
• Define the technical roadmap and architect scalable foundational infrastructure, including creative data engines, generation and rendering pipelines, and agentic orchestration frameworks.
• Design and optimize distributed systems to manage complex GenAI and heavy media-processing workloads efficiently.
• Build and mature experiment and learning infrastructure to accelerate model training, evaluation, and rapid deployment.
• Partner with Product Management, Research, and executive leadership to align infrastructure capabilities with long-term business goals; guide, mentor, and elevate engineers on the team.

Skills

Software development experience

Large-scale infrastructure

Distributed systems

Compute/storage hardware architecture

Software design and architecture

ML infrastructure design/deployment

Education

Bachelor's degree in Computer Science or related field

Master’s degree or PhD in Engineering/CS or related field

Tools

TensorFlow

PyTorch

Cloud technologies

Distributed data technologies

Job description

Google is seeking a software engineer to lead architecting and scaling next-generation infrastructure powering AI/ML applications across Ads, YouTube, and GenAI research. You will drive high-throughput systems for creative generation and optimization, while aligning with business goals and mentoring engineers.

You will design and deploy scalable data engines, generation pipelines, and orchestration frameworks, balancing performance with reliability in a distributed environment.