Senior Infrastructure Engineer, Edge-LLM CI/CD & Cloud

2100 NVIDIA USA; Santa Clara (CA); Hybrid; USD 184,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Hybrid work

Job summary

NVIDIA's TensorRT Infrastructure group is seeking a Senior Infrastructure Software Engineer to enable the next generation of edge AI. This is a pivotal role to define the infrastructure/DevOps landscape for an emerging product, building scalable, modular systems across NVIDIA's platforms.

You will build and maintain infrastructure for TensorRT Edge-LLM, automate CI/CD pipelines, and deploy with Kubernetes/Docker while ensuring reliable builds across embedded and desktop systems.

Qualifications

• BS or equivalent experience or higher in Computer Science or Computer Engineering
• 7+ years of proven software engineering experience
• Strong programming skills in Python and familiarity with modern C/C++ development
• Experience setting up, maintaining, and automating CI systems (e.g. Jenkins, GitHub Actions, GitLab CI)
• Experience administering, monitoring, and deploying systems on GitHub and cloud platforms (AWS, GCP, Azure)
• Fluency in SCM tools (Git, Perforce) and build systems (CMake, Make, Bazel)

Responsibilities

• Build and maintain infrastructure for TensorRT Edge-LLM
• Maintain CI/CD pipelines to automate builds, tests, and deployment
• Configure and extend deployments using Kubernetes, Docker, and related tools
• Develop across the software stack from UX/UI to cluster layers
• Monitor and optimize embedded and desktop systems for CI/CD reliability
• Address security CVEs for infrastructure components

Skills

Python

C/C++

CI/CD

Git

Cloud platforms

Build systems

Education

Bachelor's degree in Computer Science or Computer Engineering

Tools

Jenkins

GitHub Actions

GitLab CI

Docker

Kubernetes

CMake

Make

Bazel

Perforce

Job description

NVIDIA's TensorRT Infrastructure group is seeking a Senior Infrastructure Software Engineer to enable the next generation of edge AI. This is a pivotal role to define the infrastructure/DevOps landscape for an emerging product, building scalable, modular systems across NVIDIA's platforms.

You will build and maintain infrastructure for TensorRT Edge-LLM, automate CI/CD pipelines, and deploy with Kubernetes/Docker while ensuring reliable builds across embedded and desktop systems.