Senior AI Infrastructure Engineer - DGX Cloud, Senior AI Infrastructure Engineer - DGX Cloud

NVIDIA; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

A leading technology firm in Bengaluru is seeking a Senior AI Infrastructure Engineer to design and maintain large-scale cloud systems for AI. The ideal candidate will have 5+ years of experience, a BS in Computer Science, and strong skills in infrastructure automation and distributed systems. You will work on the reliability and performance of GPU cloud services while collaborating on innovative AI solutions. Join us if you are passionate about technology and want to make an impact.

Qualifications

• 5+ years of experience in a relevant role.
• Experience in developing tools for cloud systems.
• Track record of initiating and collaborating on projects.

Responsibilities

• Design, build, deploy, and run internal tooling for AI platforms.
• Conduct performance analysis on multi-GPU clusters.
• Improve service lifecycle from design through deployment.
• Measure and monitor service availability and latency.
• Support production systems as part of an on-call rotation.

Skills

Infrastructure automation

Distributed systems design

Coding in Python

Linux

Networking

Container technologies

Cloud systems

Terraform

Education

BS degree in Computer Science or related field

Job description

NVIDIA is looking for an outstanding, passionate, and talented Senior AI Infrastructure Engineer to join our DGX Cloud group. This engineering role will design, build and maintain large‑scale production systems with high efficiency and availability using a combination of software and systems engineering practices. The role requires knowledge across systems, networking, coding, databases, capacity management, continuous delivery, and open‑source cloud enabling technologies such as Kubernetes and OpenStack. The AI Infrastructure Engineer ensures that our GPU cloud services run with maximum reliability and uptime while making changes to existing systems through careful preparation and planning.

What You’ll Be Doing

• Design, build, deploy, and run internal tooling for large‑scale AI training and inference platforms built on top of cloud infrastructure
• Conduct in‑depth performance characterization and analysis on large multi‑GPU and multi‑node clusters
• Engage in and improve the whole lifecycle of services—from inception and design through deployment, operation, and refinement
• Support services before they go live through activities such as system design consulting, developing software tools, platforms, and frameworks, capacity management, and launch reviews
• Maintain services once they are live by measuring and monitoring availability, latency, and overall system health
• Scale systems sustainably through mechanisms such as automation, and evolve systems by pushing for changes that improve reliability and velocity
• Practice sustainable incident response and blameless post‑mortems
• Be part of an on‑call rotation to support production systems

What We Need To See

• BS degree in Computer Science or a related technical field involving coding (e.g., physics or mathematics), or equivalent experience
• 5+ years of experience
• Track record showing a balance between initiating your own projects, convincing others to collaborate, and collaborating well on projects initiated by others
• Experience with infrastructure automation and distributed systems design, developing tools for running large‑scale private or public cloud systems in production
• Experience in one or more of the following: Python, Go, C/C++, Java
• In‑depth knowledge in one or more of Linux, networking, storage, and container technologies
• Experience with public cloud and Infrastructure as Code (IaC) tools such as Terraform
• Distributed system experience

Ways To Stand Out From The Crowd

• Interest in crafting, analyzing, and fixing large‑scale distributed systems
• Systematic problem‑solving approach, coupled with strong communication skills and a sense of ownership and drive
• Ability to debug and optimize code and automate routine tasks
• Experience in using or running large private and public cloud systems based on Kubernetes or Slurm

NVIDIA is widely considered to be one of the technology world’s most desirable employers. We have some of the most forward‑thinking and hard‑working people in the world working for us. If you are creative, autonomous, and love a challenge, we want to hear from you. NVIDIA is leading the way in groundbreaking developments in Artificial Intelligence, High‑Performance Computing and Visualization. The GPU, our invention, serves as the visual cortex of modern computers and is at the heart of our products and services.