Distinguished Engineer, GPU Fleet Operations Automation, Distinguished Engineer, GPU Fleet Oper[...]

NVIDIA; New York (NY); On-site; USD 308,000 - 471,500; Full time

Benefits offered by this job

Equity

Benefits

Job summary

A leading technology company in New York is seeking a Distinguished Engineer to lead GPU fleet operations automation. This role involves defining the technical strategy and implementing solutions that ensure high availability and operational standards. The ideal candidate will have 15-18 years of experience in operations and cloud infrastructure, along with strong leadership and collaboration skills. A competitive salary range of $308,000 to $471,500 is offered, along with equity and benefits.

Qualifications

• 15-18+ years in technical roles focused on operations and automation.
• 5-10+ years of lead experience.
• Technical proficiency in AI/ML platforms and applications.

Responsibilities

• Define and drive the technical implementation for GPU fleet lifecycle.
• Collaborate on cross-domain strategies for DGX Cloud engineering practices.
• Engage stakeholders to ensure operational excellence.

Skills

Operations and automation for cloud infrastructure

Technical leadership

Strong collaboration and influence skills

Multi-tenant data center and cloud-native architectures

Application of Artificial Intelligence

Education

BS/MS or higher in systems/software engineering

Tools

Kubernetes

Slurm

Job description

Distinguished Engineer, GPU Fleet Operations Automation

Join to apply for the Distinguished Engineer, GPU Fleet Operations Automation role at NVIDIA

NVIDIA is leading the industry in delivering accelerated computing in cloud and enterprise environments. We’re a team of innovative engineers dedicated to solving some of the world’s biggest challenges, constantly driving advancements, and impacting millions of lives worldwide!

As a technology leader at NVIDIA, you will lead the development of DGX Cloud strategy for GPU fleet lifecycle, health, observability and utilization monitoring, and remediation. You will define and drive the technical strategy across multiple environments (bare metal, cloud service provider, and neoclouds). Including defining and developing the auto-remediation strategies to detect, fix, validate, and restore-to-service critical systems. You will work with NVIDIA leadership cross-organizationally and cross-functionally to deliver accelerated computing infrastructure that enables customers with the highest availability and operational standards.

What You’ll Be Doing

• Various Architectural Work: define and drive the technical implementation for DGX Cloud operations practice for GPU fleet lifecycle.
• Collaborate on Cross Domain Disciplines: drive the technical strategy and awareness for best practices and technical capabilities into DGX Cloud engineering practices.
• Accelerate Integration: Guide the technical delivery into DGX Cloud across all delivery environments: enterprise, public cloud, and high security, isolated, sovereign.
• Engage Stakeholders: Collaborate with customers, infrastructure providers, and partners to ensure NVIDIA’s solutions set the industry standard for operational excellence.
• Full Software and System Lifecycle: From ideation to architecture, design, development, deployment, operations, and full lifecycle management, lead all technical aspects of planning and continuous evolution of large technical scope.

What We Need To See

• 15-18+ overall years in technical roles with a focus on operations and automation for cloud infrastructure, platforms, and applications.
• 5-10+ years of lead experience.
• BS/MS or higher or equivalent experience in systems / software engineering, or related engineering fields.
• Technical proficiency in multi-tenant data center and cloud-native architectures, with bare metal, virtualization, containerization, and higher level abstractions (IaaS, Kubernetes, Slurm), AI/ML platforms and applications.
• Shown success delivering high-impact technically complex solutions that achieve high levels of transparency into resource utilization, performance, and operational insights.
• Technical Leadership: Ability to synthesize multi-functional needs into architecture and design while guiding internal execution across complementary teams.
• Communication and Partnership: Strong collaboration and influence skills, capable of leading engineering engagement, presenting with peers, partners, and working with high performance accelerated computing customers.

Ways To Stand Out From The Crowd

• Application of Artificial Intelligence: Real world experience applying AI to component and system level issue identification and remediation.
• Industry Expertise: Direct experience in designing, developing, delivering and operating highly available scaled out systems in enterprise and cloud environments.
• Engineering Enablement: Demonstrated history of creating scalable processes and extensible systems that facilitate operations at scale.
• Open Source Collaboration: Familiarity with open source ecosystems and projects. Ability to collaborate and influence in open source project governance, represent NVIDIA customers and partners interests in technical alignment and direction.

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 308,000 USD - 471,500 USD. You will also be eligible for equity and benefits.

Applications for this job will be accepted at least until January 6, 2026.

JR2009307

NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.