Senior Generative AI Solutions Architect – Inference & MLOps

NVIDIA Corporation; United States; Remote; USD 184,000 - 288,000; Full time

Job summary

NVIDIA Corporation is seeking an experienced AI Solutions Architect to guide customers building solutions on our Generative AI and LLM platforms. You will partner with engineering, product and field teams to design high-value, scalable inference solutions using NVIDIA software and GPU technologies.

You will work with developers, researchers and data scientists, evaluating performance and power efficiency of AI inference workloads on Kubernetes, and travel up to 20% to engage with lighthouse

Qualifications

• 8+ years of hands-on experience with Deep Learning frameworks such as PyTorch and TensorFlow.
• Strong fundamentals in programming, optimizations, and software design, especially in Python.
• Experience with containerization and orchestration technologies, monitoring, and observability solutions for AI deployments.
• Excellent knowledge of the theory and practice of LLM and DL inference.
• Excellent presentation, communication and collaboration skills.

Responsibilities

• Partnering with other solution architects, engineering, product and business teams.
• Understanding strategies and technical needs and helping define high-value solutions.
• Engaging with developers, researchers, and data scientists across technical areas.
• Strategically partnering with lighthouse customers and industry-specific solution partners.
• Working with customers to adopt and build solutions using NVIDIA tech and MLOps.
• Analyzing performance and power efficiency of AI inference workloads on Kubernetes.
• Travel to conferences and customers may be required (20%).

Skills

PyTorch

TensorFlow

Python

Kubernetes

C/C++

Problem solving

Communication

Collaboration

Education

BS, MS or PhD in CS/EE/Physics/Math or related fields

Tools

NVIDIA NIM

Dynamo

TensorRT

TensorRT-LLM

NVIDIA GPUs

MIG management

Job description

NVIDIA Corporation is seeking an experienced AI Solutions Architect to guide customers building solutions on our Generative AI and LLM platforms. You will partner with engineering, product and field teams to design high-value, scalable inference solutions using NVIDIA software and GPU technologies.

You will work with developers, researchers and data scientists, evaluating performance and power efficiency of AI inference workloads on Kubernetes, and travel up to 20% to engage with lighthouse