Senior Edge AI Infra Engineer: TensorRT/LLM CI/CD

NVIDIA; Santa Clara (CA); On-site; USD 184,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA seeks a Senior Infrastructure Software Engineer for TensorRT Edge-LLM in Santa Clara. You will design scalable, modular infrastructure to streamline development, builds, and tests across NVIDIA's platforms, from Drive AGX to Jetson, while collaborating with external partners.

You will own CI/CD pipelines, deploy tools like Kubernetes, Docker, GitHub Actions, and contribute across the stack from UX to cluster layers. A highly autonomous role with broad impact.

Qualifications

• BS or equivalent in Computer Science or Computer Engineering.
• 7+ years of proven software/infrastructure experience.
• Strong Python and modern C/C++ development experience.
• Experience setting up and automating CI systems (Jenkins, GitHub Actions, GitLab CI).
• Experience deploying and monitoring systems on AWS, GCP, Azure.
• Fluency with SCM and build systems (Git, Perforce, CMake, Make, Bazel).

Responsibilities

• Build and maintain infrastructure to deliver TensorRT Edge-LLM.
• Maintain CI/CD pipelines to automate builds, tests, and deployments.
• Configure and extend deployments of tools like CMake, GitLab, GitHub Actions, Kubernetes, Docker.
• Develop across the stack from UX to cluster layers.
• Monitor embedded/desktop CPU and GPU systems to ensure CI/CD reliability.
• Scan and address security CVEs for infrastructure components.

Skills

Python

C/C++

CI/CD

GitHub Actions

AWS/GCP/Azure

Git

Perforce

Education

BS in Computer Science or Computer Engineering

Tools

Kubernetes

Docker

Jenkins

GitHub Actions

GitLab CI

CI/CD tooling

Job description

NVIDIA seeks a Senior Infrastructure Software Engineer for TensorRT Edge-LLM in Santa Clara. You will design scalable, modular infrastructure to streamline development, builds, and tests across NVIDIA's platforms, from Drive AGX to Jetson, while collaborating with external partners.

You will own CI/CD pipelines, deploy tools like Kubernetes, Docker, GitHub Actions, and contribute across the stack from UX to cluster layers. A highly autonomous role with broad impact.