Senior Cosmos Infrastructure & E2E Performance Engineer

NVIDIA Gruppe; Santa Clara (CA); On-site; USD 184,000 - 288,000; Full time

Benefits offered by this job

Equity

Benefits

Job summary

NVIDIA Cosmos is recruiting a Senior Software Engineer to advance infrastructure for world foundation models and end-to-end performance. You will optimize large-scale AI workloads, shape distributed systems for data centers and edge deployments, and collaborate with customers to simplify usage and expand the ecosystem.

Bring a Master’s in a related field and 5+ years of experience, with strong Python/C/C++, Distributed PyTorch, and CUDA skills. Expect an equity package and comprehensive benefits.

Qualifications

• Masters in Computer Engineering, CS, EE or related STEM with 5+ years of experience.
• Expertise with large scale parallel and distributed accelerator-based systems.
• Expertise optimizing AI workloads and performance modeling at scale.
• Proficiency in Distributed PyTorch; Python, C/C++. Strong background in Computer Architecture, Networking, Storage, Accelerators.
• Understanding of DNNs and their use in AI/ML applications.
• Experience with at least one public CSP (GCP AWS Azure OCI).
• Experience automating multimodal data ingestion and curation; tokenization and dataset prep is a plus.
• Experience building transformer models or RL fine-tuning and post-training frameworks.
• Understanding optimization for inference - export, quantization and containerization.

Responsibilities

• Build SOTA world foundation models (e.g., Cosmos3).
• Drive end-to-end performance analysis and HW-SW codesign for data center and edge deployments.
• Engage with customers to ensure Cosmos models are easy to use and ecosystem-friendly.
• Develop infrastructure to automate data ingestion, curation, pre-training, post-training, export/quantization, and edge deployment.
• Design for robustness and fault tolerance.

Skills

Python

C/C++

Distributed PyTorch

CUDA

Computer Architecture

Networking

Storage systems

Performance optimization

DNNs

Public CSP infrastructure (GCP AWS OCI

Education

Master's degree in Computer Engineering / Computer Science / Electrical Engineering

Tools

PyTorch

TensorFlow

Megatron-LM

JAX

Cosmos

Tensort-LLM

VLLM

Job description

NVIDIA Cosmos is recruiting a Senior Software Engineer to advance infrastructure for world foundation models and end-to-end performance. You will optimize large-scale AI workloads, shape distributed systems for data centers and edge deployments, and collaborate with customers to simplify usage and expand the ecosystem.

Bring a Master’s in a related field and 5+ years of experience, with strong Python/C/C++, Distributed PyTorch, and CUDA skills. Expect an equity package and comprehensive benefits.