Senior Software Engineer, AI Frameworks

NVIDIA AI; Santa Clara (CA); On-site; USD 170,000 - 250,000; Full time

Benefits offered by this job

Equity

Health Insurance

Job summary

NVIDIA AI in Santa Clara is seeking an experienced engineer to design and implement end-to-end integrations of AI frameworks with production-grade adapters and runtime components, enabling scalable training and inference across distributed stacks.

Applicants should have BS/MS/PhD in CS or related field with 5+ years in AI framework integration and strong software skills in Go, C++, Python, and Kubernetes. Experience with PyTorch and Ray is a plus.

Qualifications

• Requires BS/MS/PhD in Computer Science or related field with at least 5 years of experience in AI framework integration.
• Candidates must possess strong software engineering skills in Go, C++, or Python and practical experience with distributed systems and Kubernetes.

Responsibilities

• Design and implement end-to-end integrations of Grove with open-source AI frameworks like PyTorch and Ray.
• Build and maintain production-grade adapters, plugins, and runtime components to ensure scalability and performance across distributed training and inference stacks.

Skills

Distributed systems

Software engineering

API development

Observability

CI/CD

Model serving

CUDA

GPU optimization

AI frameworks

AI frameworks

Observability

Education

BS/MS/PhD in CS or related field

Tools

Go

C++

Python

Kubernetes

PyTorch

Ray

Job description

Design and implement end-to-end integrations of Grove with open-source AI frameworks like PyTorch and Ray. Build and maintain production-grade adapters, plugins, and runtime components to ensure scalability and performance across distributed training and inference stacks.

Requirements:

Requires a BS/MS/PhD in Computer Science or related field with at least 5 years of experience in AI framework integration. Candidates must possess strong software engineering skills in Go, C++, or Python and practical experience with distributed systems and Kubernetes.

Key Skills:

AI Frameworks, PyTorch, Ray, Kubernetes, Go, C++, Python, Distributed Systems, CUDA, GPU Optimization, Model Serving, Containerization, CI/CD, Software Engineering, API Development, Observability

Benefits:

Equity, Health Insurance