Senior Software Engineer, Agent Performance Modeling

NVIDIA Corporation

Santa Clara (CA)

Hybrid

USD 152,000 - 288,000

Full time

2 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Equity
Benefits

Job summary

NVIDIA Corporation is seeking a senior engineer to build and validate performance models for LLM architectures across GPU, LPU, and heterogeneous systems. You will develop agents to automate simulation workflows, analyze bottlenecks, and accelerate design space exploration.

Collaborating with hardware architecture, inference, runtime, and compiler teams, you will improve modeling accuracy and guide optimization while applying rigorous experimentation and productive software engineering

Qualifications

  • MS in Computer Science or related field, with 5+ years of experience.
  • Familiarity with modern LLM architectures and their inference characteristics.
  • Experience with simulation, profiling, or performance modeling, including roofline analysis for LLM inference.
  • Strong analytical skills and a rigorous approach to experimentation and validation.
  • Strong software engineering skills and experience building reliable engineering tools using coding agents like Claude Code, Codex, etc.

Responsibilities

  • Build and validate performance models for LLM architectures across GPU, LPU, and heterogeneous systems.
  • Develop agents to automate simulation workflows, analyze bottlenecks, and accelerate design space exploration.
  • Collaborate with hardware architecture, inference, runtime, and compiler teams to improve modeling accuracy and guide optimization.

Skills

LLM architectures
Simulation workflows
Performance modeling
Software engineering
Coding agents tools

Education

MS in Computer Science

Tools

Claude Code
Codex

Job description

Today, NVIDIA is tapping into the unlimited potential of AI to define the next era of computing, an era in which our GPUs act as the brains of computers, robots, and self-driving cars that can understand the world. Doing what's never been done before takes vision, innovation, and the world's best talent. As an NVIDIAN, you'll be immersed in a diverse, encouraging environment where everyone is inspired to do their best work. As LLM architectures and inference workloads evolve, understanding how they map to hardware is critical to designing efficient AI systems. Our team combines simulation and agentic engineering to understand emerging architectures and inform hardware and software decisions.

What you'll be doing:
  • Building and validating performance models for LLM architectures across GPU, LPU, and heterogeneous systems.
  • Developing agents to automate simulation workflows, analyze bottlenecks, and accelerate design space exploration.
  • Collaborating with hardware architecture, inference, runtime, and compiler teams to improve modeling accuracy and guide optimization.
What we need to see:
  • MS in Computer Science or a related field, with 5+ years of experience.
  • Familiarity with modern LLM architectures and their inference characteristics.
  • Experience with simulation, profiling, or performance modeling, including familiarity with roofline analysis for LLM inference.
  • Strong analytical skills and a rigorous approach to experimentation and validation.
  • Strong software engineering skills and experience building reliable engineering tools using coding agents like Claude Code, Codex, etc.
Ways to stand out from the crowd:
  • Experience building agents that automate complex engineering workflows.
  • Knowledge of accelerator architecture and compute, memory, or communication bottlenecks.
  • Open-source contributions in agentic systems, simulation, or inference optimization.

NVIDIA is widely considered one of the technology world's most desirable employers. We have some of the most forward-thinking and hardworking people in the world working for us. If you're creative, analytical, and autonomous, we want to hear from you! #LI-Hybrid

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is 152,000 USD - 241,500 USD for Level 3, and 184,000 USD - 287,500 USD for Level 4. You will also be eligible for equity and benefits. Applications for this job will be accepted at least until October 13, 2026.

This posting is for an existing vacancy. NVIDIA uses AI tools in its recruiting processes.

NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer. As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

NVIDIA pioneered accelerated computing. Today, our AI infrastructure powers global intelligence, transforming every industry. Learn more about NVIDIA.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Software Engineer - GPU Local AI Platforms
Senior Software Engineer - GPU Local AI Platforms

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 431,000
Senior Software Engineer - AI Inference Performance
Senior Software Engineer - AI Inference Performance

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Senior Software Engineer - GPU Local AI Platforms
Senior Software Engineer - GPU Local AI Platforms

NVIDIA • Durham (NC)

On-site
USD 224,000 - 356,500
Equity
Benefits
Senior Software Engineer - GPU Local AI Platforms
Senior Software Engineer - GPU Local AI Platforms

NVIDIA • Austin (TX)

On-site
USD 224,000 - 431,250
Equity
Benefits
Senior Software Engineer - GPU Local AI Platforms
Senior Software Engineer - GPU Local AI Platforms

NVIDIA • Westford (MA)

On-site
USD 224,000 - 431,250
Senior High Performance AI Engineer, Agentic AI
Senior High Performance AI Engineer, Agentic AI

NVIDIA Gruppe • Santa Clara (CA)

On-site
USD 152,000 - 242,000
Senior AI Systems Engineer, Chip Design
Senior AI Systems Engineer, Chip Design

NVIDIA • United States

Remote
USD 184,000 - 357,000
Equity
Benefits package
Senior AI Engineer, AI tools
Senior AI Engineer, AI tools

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 224,000 - 357,000
Equity
Benefits
Senior Systems Software Engineer - Machine Learning
Senior Systems Software Engineer - Machine Learning

NVIDIA • Santa Clara (CA)

On-site
USD 184,000 - 288,000
Senior High Performance AI Engineer, Agentic AI
Senior High Performance AI Engineer, Agentic AI

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 152,000 - 242,000