Senior System Engineer - Agentic AI Inference Equity

NVIDIA

United States

Híbrido

USD 272.000 - 431.000

Jornada completa

14 días+

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Equity
Benefits

Descripción de la vacante

NVIDIA Corporation is seeking a Senior System Software Engineer to join its Dynamo AI inference team in the United States. You will develop open source software to enable GPU-accelerated inference for state-of-the-art models and contribute to disaggregated serving across vLLM, SGLang, and TensorRT-LLM.

The role emphasizes performance, scalability, and advanced memory management in a fast-paced environment. The ideal candidate has 10+ years in CS/CE, a Master’s/PhD, and strong Rust and Python

Formación

  • Master's or PhD or equivalent experience in CS/CE.
  • 10+ years in CS, CS engineering or related field.
  • Strong Rust and Python software design and debugging skills.

Responsabilidades

  • Develop open source software to serve inference of trained AI models running on GPUs.
  • Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM).
  • Optimize inference-state management for long-running agents and memory hierarchies to reduce latency and costs.
  • Build and evolve Dynamo's distributed inference frontend across multiple engines with day-0 support and API compatibility.

Conocimientos

Rust
Python
Performance optimization
Distributed systems

Educación

Master's degree or PhD in CS/CE

Herramientas

vLLM
TensorRT-LLM
SGLang

Descripción del empleo

NVIDIA Corporation is seeking a Senior System Software Engineer to join its Dynamo AI inference team in the United States. You will develop open source software to enable GPU-accelerated inference for state-of-the-art models and contribute to disaggregated serving across vLLM, SGLang, and TensorRT-LLM.

The role emphasizes performance, scalability, and advanced memory management in a fast-paced environment. The ideal candidate has 10+ years in CS/CE, a Master’s/PhD, and strong Rust and Python

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior AI Inference Systems Engineer
Senior AI Inference Systems Engineer

NVIDIA Corporation • Santa Clara (CA)

Híbrido
USD 224.000 - 431.250
Equity
Benefits
Senior System Software Engineer, Agentic Inference - Dynamo
Senior System Software Engineer, Agentic Inference - Dynamo

NVIDIA • EE. UU.

Híbrido
USD 272.000 - 431.000
Equity
Benefits
Senior System Software Engineer — GPU AI Inference (Triton)
Senior System Software Engineer — GPU AI Inference (Triton)

NVIDIA Corporation • Santa Clara (CA)

Presencial
USD 152.000 - 241.500
Equity
Benefits
Senior GPU AI Inference Systems Engineer
Senior GPU AI Inference Systems Engineer

NVIDIA Corporation • California

Presencial
USD 196.000 - 288.000
Equity
Comprehensive benefits
Senior AI Systems Engineer: Agentic CUDA & GPUs, Equity
Senior AI Systems Engineer: Agentic CUDA & GPUs, Equity

NVIDIA Corporation • Santa Clara (CA)

Presencial
USD 152.000 - 242.000
Senior System Software Engineer, Agentic Inference - Dynamo
Senior System Software Engineer, Agentic Inference - Dynamo

NVIDIA Corporation • Santa Clara (CA)

Híbrido
USD 224.000 - 431.250
Equity
Benefits
Senior System Software Engineer - Dynamo-Triton Inference Server
Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA Corporation • Santa Clara (CA)

Presencial
USD 152.000 - 241.500
Equity
Benefits
Senior System Software Engineer - Dynamo-Triton Inference Server
Senior System Software Engineer - Dynamo-Triton Inference Server

NVIDIA Corporation • California

Presencial
USD 196.000 - 288.000
Equity
Comprehensive benefits
Senior AI Inference Architect — Equity & Scalable GPU Solutions
Senior AI Inference Architect — Equity & Scalable GPU Solutions

NVIDIA Corporation • Santa Clara (CA)

Presencial
USD 184.000 - 356.000
Equity
Comprehensive benefits
Senior Gen AI Inference Engineer (Equity Eligible)
Senior Gen AI Inference Engineer (Equity Eligible)

NVIDIA Corporation • Washington

Híbrido
USD 192.000 - 357.000
Equity
Benefits