Senior AI Frameworks Engineer — Equity & Open-Source Impact

NVIDIA; California (MO); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Software Engineer to drive Grove integrations with Dynamo and major AI frameworks, delivering production-grade software for adoption, scaling, and operation across environments such as PyTorch, Ray, and Kubernetes-based stacks.

You will design adapters, runtimes, and workflows, partner with framework owners, and contribute patches for long-term maintainability while improving observability and performance in distributed training/inference systems.

Qualifications

• BS/MS/PhD in Computer Science, Electrical Engineering, or related field (or equivalent experience).
• 5+ years of proven experience in related field.
• Hands-on experience integrating with at least one major AI framework/runtime (e.g., PyTorch, Ray, Triton Inference Server ecosystem).
• Solid understanding of AI workloads: model development basics, training vs. inference tradeoffs, and performance considerations.
• Experience with distributed systems concepts (RPC, scheduling, fault tolerance, resource management).
• Practical Kubernetes experience: deploying and operating services/jobs, Helm/Kustomize, operators/controllers, and debugging clusters.
• Familiarity with containers and cloud-native tooling (Docker, container registries, CI/CD pipelines).
• Strong software engineering experience in Go, C++ and/or Python, with a track record of shipping reliable systems.
• Strong interpersonal skills and ability to collaborate across teams and with open-source communities.
• Exceptional collaboration, communication, and documentation habits.

Responsibilities

• Design and implement end-to-end integrations of Grove with open-source AI frameworks (e.g., Dynamo, llm-d, Ray, PyTorch, and related ecosystem projects).
• Build and maintain adapters, plugins, operators, and/or runtime components that enable Grove features to work smoothly across training and inference stacks.
• Partner with framework owners to upstream changes, contribute patches, and ensure long-term maintainability of integrations.
• Develop reference workflows, sample apps, and best-practice guides that accelerate adoption by users and partners.
• Optimize performance, scalability, and reliability for distributed training/inference, including multi-node and multi-GPU environments.
• Improve observability and operational readiness (metrics, logging, tracing, debugging tools) for Kubernetes-based deployments.
• Participate in technical design reviews, define APIs/contracts, and ensure compatibility across versions of frameworks and dependencies.
• Diagnose complex issues spanning containers, networking, scheduling, CUDA/GPU utilization, and framework runtime behavior.

Education

BS/MS/PhD in Computer Science, Electrical Engineering, or related field (or equivalent experience)

Tools

Kubernetes

Docker

CI/CD pipelines

Job description

NVIDIA is seeking a Senior Software Engineer to drive Grove integrations with Dynamo and major AI frameworks, delivering production-grade software for adoption, scaling, and operation across environments such as PyTorch, Ray, and Kubernetes-based stacks.

You will design adapters, runtimes, and workflows, partner with framework owners, and contribute patches for long-term maintainability while improving observability and performance in distributed training/inference systems.