Senior Cosmos Infra & End-to-End Performance Engineer

NVIDIA; Santa Clara (CA); On-site; USD 152,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA in Santa Clara seeks a Senior Software Engineer for Cosmos Infrastructure and End to End Performance to help build the open omni-model platform and accelerate Physical AI. You will design and optimize distributed systems, work on data center and edge deployments, and collaborate with teams to enable an open ecosystem.

Requires a Masters in a STEM field, strong C/C++, Python, distributed systems experience, and CUDA expertise, with demonstrated AI/ML knowledge and CSP infra exposure.

Qualifications

• Masters in Computer Engineering, CS, EE or related STEM with equivalent experience.
• Expertise in large scale parallel and distributed accelerator-based systems.
• Expertise optimizing performance and AI workloads at scale.
• Proficiency in Distributed PyTorch; Python, C/C++. Strong background in architecture, networking, storage, accelerators.
• Understanding of DNNs and their use in AI/ML applications.
• Experience with public CSP infrastructure (GCP, AWS, Azure, OCI, ...).
• Deep understanding of World Foundation Models and their application to Physical AI.
• Experience automating multimodal data ingestion and curation; tokenization and dataset prep a plus.
• Experience building transformer models or post-training RL workflows; inference optimization (export, quantization, containerization).
• Familiarity with frameworks (TensorFlow, JAX, Cosmos, Megatron-LM, Tensort-LLM, VLLM).

Responsibilities

• Building SoTA world foundation models (like Cosmos3).
• Engage with end-to-end performance analysis and drive HW-SW codesign for data center and edge deployments.
• Engage with customers to ensure Cosmos models are easy to use and enabling the ecosystem.
• Develop infrastructure to automate data ingestion, curation, pre-training, post-training, export/quantization and edge deployment.
• Design for robustness and fault tolerance.

Skills

Distributed PyTorch

Python

C/C++

Computer Architecture

Networking

Storage systems

Accelerators

DNNs understanding

Public CSP infra

World Foundation Models

Data ingestion pipelines

Education

Master's degree in Computer Engineering, Computer Science, Electrical Engineering or related STEM

Tools

CUDA

TensorFlow

JAX

Megatron-LM

Tensort-LLM

VLLM

Cosmos

Job description

NVIDIA in Santa Clara seeks a Senior Software Engineer for Cosmos Infrastructure and End to End Performance to help build the open omni-model platform and accelerate Physical AI. You will design and optimize distributed systems, work on data center and edge deployments, and collaborate with teams to enable an open ecosystem.

Requires a Masters in a STEM field, strong C/C++, Python, distributed systems experience, and CUDA expertise, with demonstrated AI/ML knowledge and CSP infra exposure.