Staff AI Infra Engineer - Large-Scale ML Training

Uber Technologies Inc.; Sunnyvale (CA); On-site; USD 232,000 - 258,000; Full time

Job summary

Uber Technologies Inc. is seeking a Staff Software Engineer for AI Infra - Training in Sunnyvale, CA. You will design and build scalable ML training systems, mentor across the stack, and drive high-impact improvements in performance and efficiency for a global platform.

This role requires deep expertise in distributed training, system design, and cross-functional leadership. Expect collaboration with Product, Data Science, and Operations to deliver scalable infrastructure and premier tooling.

Qualifications

• 8+ years of professional experience building scalable, fault-tolerant products or platforms.
• Proficiency in one or more programming languages (Go, C/C++, Java, Python, or JavaScript) and the ability to define organization-wide standards.
• Proficiency in state of the art deep learning technologies, such as distributed training frameworks, LLMs, GPU optimizations, etc.
• Proven experience leading large-scale engineering projects through the entire lifecycle from inception to global productionization.
• Expertise in making complex engineering/business tradeoffs, managing the implications of buy vs. build or incremental vs. rewrite decisions.
• Experience identifying architectural gaps and acting as a multiplier to reduce technical debt across the organization.
• Bachelor's degree in Computer Science, Engineering, Mathematics, or equivalent practical experience.

Responsibilities

• Design and build end-to-end systems for Uber's ML training stack.
• Provide deep technical mentorship across the stack, ensuring architecture and implementations are robust, extensible, and secure.
• Build innovative solutions that leverage statistical analysis to diagnose performance regressions and optimize resource utilization across complex infrastructures.
• Create best-in-class tools and frameworks that increase the velocity and quality of hundreds of internal engineering teams.
• Lead and mentor engineers, reviewing code and designs while fostering a culture of continuous learning and humility.
• Work cross-functionally with Product, Data Science, and Operations across the globe to drive large-scale projects and align technical investments with business value.

Skills

8+ years experience

Programming languages

Deep learning infra

Leadership experience

Tradeoff decisions

Architectural reviews

Education

Bachelor's degree in CS/Engineering

Tools

Distributed training frameworks

GPU optimizations

Open-source contributions

Job description

Uber Technologies Inc. is seeking a Staff Software Engineer for AI Infra - Training in Sunnyvale, CA. You will design and build scalable ML training systems, mentor across the stack, and drive high-impact improvements in performance and efficiency for a global platform.

This role requires deep expertise in distributed training, system design, and cross-functional leadership. Expect collaboration with Product, Data Science, and Operations to deliver scalable infrastructure and premier tooling.