Senior Platform Architect for AI Agent Execution

Socket.dev; Santa Clara (UT); On-site; USD 184,000 - 357,000; Full time

Job summary

NVIDIA is seeking a Senior Software Engineer to help build the NeMo Platform, an open source plugin-based AI platform for running and optimizing Agents across backends like local/docker, Kubernetes, and Slurm. You will lead architectural decisions and own Core Platform APIs, contributing to production-grade, scalable AI tooling.

The role demands deep experience with distributed systems, cloud-native services, and robust Python engineering, with strong communication and leadership to guide

Qualifications

• BS, MS, or equivalent experience in Computer Science, Computer Engineering, or a related field.
• 10+ years of professional software engineering experience building production systems.
• Strong design skills and ability to work in fast, ambiguous environments.
• Excellent written and verbal communication; ability to discuss complex architectural topics with diverse audiences.
• Experience with distributed systems, cloud-native services, containers, Kubernetes, and job orchestration.
• Proficient Python engineering skills including API design, typing, testing, debugging, performance analysis.

Responsibilities

• Design an Agentic Execution system flexible for multiple environments (local, Kubernetes, Slurm, on‑prem/air-gapped).
• Provide senior technical leadership through design reviews, code reviews, and mentoring.
• Build and maintain Core Platform APIs for running jobs, data, secrets, RBAC, and auth.
• Extend a plugin architecture enabling teams and customers to install new capabilities.
• Improve reliability, observability, debugging, and performance across NeMo Platform and workflows.
• Build strong test coverage across unit, integration, E2E, Docker, and Kubernetes workflows.

Skills

Python programming

Distributed systems

Kubernetes

API design

Software architecture

Communication

Leadership

Education

BS/MS in Computer Science or Engineering

Tools

Docker

Job description

NVIDIA is seeking a Senior Software Engineer to help build the NeMo Platform, an open source plugin-based AI platform for running and optimizing Agents across backends like local/docker, Kubernetes, and Slurm. You will lead architectural decisions and own Core Platform APIs, contributing to production-grade, scalable AI tooling.

The role demands deep experience with distributed systems, cloud-native services, and robust Python engineering, with strong communication and leadership to guide