Senior Platform Engineer for AI Agents & Orchestration

NVIDIA; New York (NY); On-site; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA is seeking a Senior Software Engineer to join the NeMo Helix Core team, shaping an open source plugin-based AI platform for agents across local, containerized, and orchestration environments. You will lead architecture, design reviews, and hands-on implementation for scalable, reliable AI systems.

You will design APIs, coordinate across teams, and contribute to OSS while delivering production-grade software with high performance and clear telemetry.

Qualifications

• BS, MS, or equivalent experience in Computer Science, Computer Engineering, or related technical field
• 10+ years of professional software engineering experience building production systems
• Excellent Python engineering skills, including API design, typing, testing, debugging, performance analysis
• Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration

Responsibilities

• Design and build an Agentic Execution system flexible across environments (local, k8s, Slurm, on prem)
• Provide senior technical leadership through design reviews and mentoring
• Develop Core Platform APIs for running jobs, storing data, entities, secrets, and RBAC/Auth
• Extend plugin architecture to allow easy integration of new capabilities
• Collaborate in OSS repo and maintain high open-source standards
• Improve reliability, observability, debuggability, and performance across NeMo Helix
• Build strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows

Skills

Python

Kubernetes

Distributed systems

Cloud-native

API design

Debugging

Code reviews

Education

BS/MS in CS/CE or related field

Tools

Docker

Git

Job description

NVIDIA is seeking a Senior Software Engineer to join the NeMo Helix Core team, shaping an open source plugin-based AI platform for agents across local, containerized, and orchestration environments. You will lead architecture, design reviews, and hands-on implementation for scalable, reliable AI systems.

You will design APIs, coordinate across teams, and contribute to OSS while delivering production-grade software with high performance and clear telemetry.