Staff AI Infra Engineer - ML Training

Uber; Sunnyvale (CA); On-site; USD 232,000 - 258,000; Full time

Job summary

Uber seeks a Staff Software Engineer for AI Infra - Training to design and scale the ML training stack across global data centers and clouds. You will mentor engineers, architect robust systems, and drive performance optimizations for very large datasets and models.

You will collaborate with Product, Data Science, and Operations worldwide to align technical investments with business value and lead critical architectural decisions.

Qualifications

• 8+ years of professional experience building scalable, fault-tolerant products or platforms.
• Proficiency in Go, C/C++, Java, Python, or JavaScript and defining organization-wide standards.
• Proficiency in state of the art deep learning technologies, such as distributed training frameworks, LLMs, GPU optimizations, etc.
• Proven experience leading large-scale engineering projects through the entire lifecycle from inception to global productionization.
• Expertise in making complex engineering/business tradeoffs and buy vs. build decisions.
• Experience identifying architectural gaps and reducing technical debt across the organization.
• Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent practical experience.

Responsibilities

• Design and build end-to-end systems for Uber's ML training stack. Solve scaling challenges on very large datasets and models.
• Provide deep technical mentorship across the stack, ensuring robust, extensible, and secure architectures.
• Build innovative solutions that diagnose performance and optimize resource utilization across complex infrastructures.
• Create best-in-class tools and frameworks to increase velocity for hundreds of teams.
• Lead and mentor engineers, review code and designs, and foster a culture of learning.
• Work cross-functionally with Product, Data Science, and Operations across the globe to drive large-scale projects.

Skills

Large-scale systems design

Mentorship

Cross-functional leadership

Strategic decision making

Education

Bachelor's degree in CS/Engineering/Math

Tools

Go

C/C++

Java

Python

JavaScript

Distributed training frameworks

LLMs

GPU optimizations

Job description

Uber seeks a Staff Software Engineer for AI Infra - Training to design and scale the ML training stack across global data centers and clouds. You will mentor engineers, architect robust systems, and drive performance optimizations for very large datasets and models.

You will collaborate with Product, Data Science, and Operations worldwide to align technical investments with business value and lead critical architectural decisions.