Senior Architect, Scaled AI Inference - Remote

Bazeta; United States; A distancia; USD 320.000 - 489.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Equity

Benefits

Descripción de la vacante

NVIDIA is seeking a Distinguished Engineer to lead the architecture of distributed, high-performance AI inferencing pipelines for large-scale model serving in enterprise and cloud environments. You will drive deployment strategies, scaling, and co-optimization for peak performance across NVIDIA’s AI stack.

You will work with product managers, hardware engineers, and research teams, shaping industry standards and contributing to open-source initiatives.

Formación

• MS or PhD in Computer Science, Electrical Engineering, or a related field (or equivalent experience).
• 15+ years of experience in distributed systems, cloud infrastructure, or AI/ML engineering.
• Deep expertise in AI inferencing frameworks, including TensorRT-LLM, vLLM, and other model serving technologies.
• Strong understanding of GPU architecture, CUDA programming, and performance optimization techniques.
• Proven track record of leading cross-functional teams and driving technical strategy at an organizational level.

Responsabilidades

• Lead the architecture and development of distributed, high-performance inferencing pipelines for large-scale AI model serving across enterprise and cloud environments.
• Define the technical strategy for model deployment, versioning, and scaling to support hundreds of thousands of requests per second with low latency and high reliability.
• Drive hardware-software co-optimization to deliver peak performance at scale.
• Guide open-source efforts and community collaboration around Dynamo, TensorRT-LLM, and inference-related projects.
• Develop and maintain relationships with product managers, hardware engineers, and research teams to align inferencing strategy with business goals.

Conocimientos

Distributed systems

Cloud infrastructure

AI Inferencing

Kubernetes

Docker

CUDA

TensorRT-LLM

vLLM

Team leadership

Educación

MS or PhD in Computer Science/EE or related

Herramientas

Kubernetes

Docker

TensorRT-LLM

CUDA

Cloud-native tech

Descripción del empleo

NVIDIA is seeking a Distinguished Engineer to lead the architecture of distributed, high-performance AI inferencing pipelines for large-scale model serving in enterprise and cloud environments. You will drive deployment strategies, scaling, and co-optimization for peak performance across NVIDIA’s AI stack.

You will work with product managers, hardware engineers, and research teams, shaping industry standards and contributing to open-source initiatives.