Senior AI Solutions Architect: Generative AI & LLM Inference

NVIDIA Corporation; Santa Clara, Northern (CA, KY); Hybrid; USD 184,000 - 288,000; Full time

Job summary

NVIDIA Corporation is seeking outstanding AI Solutions Architects to help customers build solutions with our latest AI technology in Santa Clara, CA. You will work across teams as a trusted technical advisor on inference for Generative AI and LLMs, collaborating with researchers, engineers and customers to design high-impact NVIDIA-based solutions.

You will analyze performance and power for AI inference workloads on Kubernetes, partner with lighthouse customers, and help adopt NVIDIA technology

Qualifications

• BS/MS/PhD in CS/EE/Physics/Math or related field (or equivalent experience).
• 8+ years hands-on experience with DL frameworks such as PyTorch and TensorFlow.
• Strong fundamentals in programming, Python.
• Proficiency in GPU orchestration and MIG management within Kubernetes environments.
• Experience with containerization and orchestration tech, monitoring and observability for AI deployments.
• Excellent knowledge of LLM/DL inference theory and practice.
• Excellent presentation, communication and collaboration skills.

Responsibilities

• Partnering with solution architects, engineering, product and business teams.
• Understanding strategies and technical needs; help define high-value solutions.
• Engage with developers, scientists, and data scientists across areas.
• Collaborate with lighthouse customers and partners targeting our computing platform.
• Help customers adopt and build solutions using NVIDIA tech and MLOps.
• Analyze performance and power efficiency of AI inference workloads on Kubernetes.
• Some travel to conferences and customers may be required (20%).

Skills

Python

Deep Learning

C/C++

Kubernetes

GPU orchestration

MIG management

Problem solving

Communication

Education

BS/MS/PhD in CS/EE/Physics/Math

Tools

NIM

TensorRT

TensorRT-LLM

Dynamo

Job description

NVIDIA Corporation is seeking outstanding AI Solutions Architects to help customers build solutions with our latest AI technology in Santa Clara, CA. You will work across teams as a trusted technical advisor on inference for Generative AI and LLMs, collaborating with researchers, engineers and customers to design high-impact NVIDIA-based solutions.

You will analyze performance and power for AI inference workloads on Kubernetes, partner with lighthouse customers, and help adopt NVIDIA technology