Senior ML Software Engineer — GPU-Accelerated PyTorch

NVIDIA; Austin (TX); On-site; USD 152,000 - 242,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA seeks a Senior Software Engineer to build scalable, PyTorch-based ML systems on GPU infrastructure in Austin. You will shape training and inference workflows for large models, mentor engineers, and collaborate with product teams to deliver high-performance solutions.

You will contribute to CUDA-X libraries, optimize code paths, and drive impactful customer-facing tooling while advancing distributed ML at scale. Equity and benefits apply.

Qualifications

• Bachelor's degree (or equivalent) + 5+ years in ML, or Master/PhD + 3+ years.
• 3+ years of PyTorch experience.
• 2+ years training enterprise-scale ML models on distributed infrastructure.
• 2+ years designing and operating GPU-based training/inference workflows.
• Excellent C++ programming and software design skills.
• Experience developing, debugging, and optimizing high-performance apps, preferably with CUDA.
• Strong collaboration, communication, and documentation habits.

Responsibilities

• Develop accelerated, PyTorch-based solutions for large-scale ML models with a focus on GPU training/inference.
• Support CUDA-X libraries and integrations used in PyTorch-based workflows.
• Collaborate with developers, PMs, and scientists to create GPU-accelerated GNN and TFM models.
• Build solutions to help customers adopt NVIDIA hardware/software and gather requirements.
• Provide technical leadership and mentorship to engineers.
• Identify opportunities to improve the codebase via re-architecture.
• Apply agentic coding tools to fix bugs, add features, and refactor code.
• Solve complex issues, explain solutions clearly, and coordinate across teams.

Skills

PyTorch

C++ programming

GPU acceleration

Distributed training

Communication

Education

Bachelor's degree or equivalent

Master's degree or PhD + 3+ years

Tools

CUDA Toolkit

FAISS / Milvus

Job description

NVIDIA seeks a Senior Software Engineer to build scalable, PyTorch-based ML systems on GPU infrastructure in Austin. You will shape training and inference workflows for large models, mentor engineers, and collaborate with product teams to deliver high-performance solutions.

You will contribute to CUDA-X libraries, optimize code paths, and drive impactful customer-facing tooling while advancing distributed ML at scale. Equity and benefits apply.