Senior AI Training Solutions Architect: Foundation Models

NVIDIA Corporation; Santa Clara (CA); On-site; USD 152,000 - 288,000; Full time

Job summary

NVIDIA is seeking a Senior Solutions Architect to help customers design and optimize AI training solutions on NVIDIA GPUs across cloud platforms. You will lead engagements from architecture through production, focusing on foundation model pre-training, post-training, and reinforcement learning workflows.

You will collaborate with customers, sales, and engineering teams to translate requirements into scalable NVIDIA-based solutions, deliver technical presentations, and drive adoption of NVIDIA

Qualifications

• BS, MS, or PhD in Computer Science, Electrical or Computer Engineering, Statistics, Physics, or a related technical field, or equivalent experience.
• 5+ years of relevant professional experience in solutions architecture, software engineering, ML engineering, research engineering, or related technical roles, including 3+ years of hands-on experience with large-scale AI systems or distributed training.
• Strong programming and debugging skills in Python, with hands-on experience developing and optimizing deep learning workloads using PyTorch.
• Practical experience with foundation model pre-training or post-training, and a strong understanding of the broader model development lifecycle.
• Demonstrated ownership of an end-to-end training workflow, including data preparation, training configuration, execution, evaluation, and troubleshooting.
• Experience with multi-GPU and multi-node training, including distributed parallelism, mixed precision, memory optimization, and checkpointing.
• Established track record of deploying GPU workloads in cloud computing environments such as AWS, GCP, or Azure, with knowledge of containers and workload orchestration.
• Ability to lead technical engagements, solve complex problems, and communicate technical ideas and tradeoffs clearly to technical and non-technical audiences.

Responsibilities

• Work with Cloud Service Providers to design, build, and demonstrate scalable AI training solutions using NVIDIA hardware and software.
• Lead technical engagements across foundation model pre-training and post-training, helping customers move from architecture and proofs of concept to production adoption.
• Develop and optimize end-to-end training workflows spanning data preparation, distributed training, checkpointing, and evaluation, including reinforcement learning pipelines.
• Build customer-specific proofs of concept that address critical technical and business needs, demonstrating improvements in training performance, reliability, and efficiency.
• Help customers diagnose and resolve bottlenecks across GPU compute, memory, communication, networking, storage, and workload orchestration.
• Partner with Sales Account Managers and Developer Relations Managers to identify opportunities and drive adoption of NVIDIA platforms for AI training.
• Prepare and deliver technical presentations, workshops, and architecture reviews for audiences ranging from researchers and engineers to technical leaders and executives.
• Establish close technical relationships with customers, lead roadmap and architecture discussions, and collaborate with NVIDIA engineering and product teams to resolve issues and inform future capabilities.

Skills

Python programming

PyTorch

Distributed training

Cloud infrastructure

Communication

Education

BS/MS/PhD in CS/EE or related

Tools

NVIDIA NeMo

Megatron Core

Megatron Bridge

PyTorch FSDP

DeepSpeed

Docker/containers

Job description

NVIDIA is seeking a Senior Solutions Architect to help customers design and optimize AI training solutions on NVIDIA GPUs across cloud platforms. You will lead engagements from architecture through production, focusing on foundation model pre-training, post-training, and reinforcement learning workflows.

You will collaborate with customers, sales, and engineering teams to translate requirements into scalable NVIDIA-based solutions, deliver technical presentations, and drive adoption of NVIDIA