Senior LSF Scheduler Architect - HPC & Multi-Cluster

NVIDIA; Santa Clara (CA); Hybrid; USD 184,000 - 357,000; Full time

Benefits offered by this job

Equity

Benefits

Hybrid work model

Job summary

NVIDIA's silicon does not tape out without the farm behind it. Our EDA compute environment runs millions of cores across federated LSF cells, and we are consolidating a dual-scheduler estate onto a single LSF platform.

This is a deep-specialist role; you will be the person the team escalates to when scheduling latency creeps up and nothing in the logs explains why. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.

Qualifications

• BS or MS in Computer Science, Computer Engineering, or equivalent experience.
• 8+ years in HPC or large-scale batch compute, with 5+ years on IBM Spectrum LSF.
• Demonstrated depth in LSF internals - debugged scheduler behavior beyond what the documentation covers, and you can explain a scheduling cycle from submission to dispatch.
• Hands-on MultiCluster experience in a production, multi-site environment.
• Strong Linux systems fundamentals, system programming languages and scripting in Python, Perl, and shell.

Responsibilities

• Owning scheduler behavior across 15-25 federated LSF cells, including mbatchd and mbschd tuning, scheduling cycle analysis, and the contention patterns that appear as cells approach host-count ceilings.
• Diagnosing MultiCluster forwarding problems - remote queue sizing, forwarding policy, cross-cluster pend behavior - where the symptom reported by users is "the farm is slow" rather than a clear failure.
• Setting the technical design for cell topology and federation as the farm grows, and deciding what belongs in a cell versus what belongs in a new one.
• Working with our IaC engineer to encode scheduler policy into a config schema that survives contact with MultiCluster, rather than one that looks clean and breaks at scale.
• Partnering directly with CAD and methodology teams on workloads that break normal assumptions: 500GB+ memory jobs, interactive-versus-batch contention, and tape-out crunch bursts.

Skills

LSF internals

HPC scheduling

MultiCluster

Linux

Python scripting

Shell scripting

IBM Spectrum LSF

Production multi-site

Education

BS or MS in Computer Science or Computer Engineering

Tools

LSF integration points (esub, eexec, elim, wrappers, RTM)

Job description

NVIDIA's silicon does not tape out without the farm behind it. Our EDA compute environment runs millions of cores across federated LSF cells, and we are consolidating a dual-scheduler estate onto a single LSF platform.

This is a deep-specialist role; you will be the person the team escalates to when scheduling latency creeps up and nothing in the logs explains why. NVIDIA is committed to fostering an inclusive work environment and proud to be an equal opportunity employer.