Senior GenAI Systems Engineer - Training & Inference

NVIDIA Corporation; Santa Clara (CA); On-site; USD 152,000 - 288,000; Full time

Job summary

NVIDIA is seeking a Senior GenAI Algorithms Engineer to advance the state-of-the-art foundation model development, training, and deployment. You will work across distributed training, reinforcement learning for LLMs/VLMs, model efficiency, multimodal AI, and open-source AI infrastructure, contributing to Megatron-LM, Megatron Bridge, and NeMo-RL.

You will design scalable data preparation systems, improve training and inference efficiency, and contribute to NVIDIA's open-source GenAI stack while

Qualifications

• MS or PhD in CS, AI, applied mathematics, or equivalent experience.
• 5+ years of relevant industry experience.
• Strong foundation in machine learning, deep learning, and optimization.
• Excellent software engineering skills, including Python and PyTorch.
• Experience building high-performance software for large-scale AI systems.
• Strong analytical, debugging, and performance optimization skills.
• Excellent communication and collaboration skills.

Responsibilities

• Data Curation & Readiness: Design scalable systems for preparing high-quality multimodal datasets for frontier foundation model training.
• Training Efficiency: Develop algorithms and systems that improve the scalability, efficiency, and cost of large-scale pre-training and post-training.
• Inference Efficiency: Advance techniques that improve inference performance, reduce deployment cost, and enable efficient serving across cloud and edge platforms.
• Open-Source AI Infrastructure: Develop reusable infrastructure and contribute brand new model support to NVIDIA's open-source GenAI training platform.

Skills

Python

PyTorch

Software engineering

Distributed systems

Analytical skills

Communication

Education

MS or PhD in CS/AI

Tools

Megatron-LM

Megatron Bridge

NeMo-RL

Hugging Face Transformers

Job description

NVIDIA is seeking a Senior GenAI Algorithms Engineer to advance the state-of-the-art foundation model development, training, and deployment. You will work across distributed training, reinforcement learning for LLMs/VLMs, model efficiency, multimodal AI, and open-source AI infrastructure, contributing to Megatron-LM, Megatron Bridge, and NeMo-RL.

You will design scalable data preparation systems, improve training and inference efficiency, and contribute to NVIDIA's open-source GenAI stack while