Senior AI Infrastructure Systems Engineer (R&D / GPU / AI)

nebius; United States; Remote; USD 180,000 - 224,000; Full time

Benefits offered by this job

Medical coverage and dental/vision for

Retirement plan with employer match

Paid parental leave

Internet/mobile stipend

Disability and life insurance

Job summary

Nebius in the United States is seeking a Senior Systems Engineer to diagnose difficult hardware and platform failures in high-performance GPU systems. You will investigate Linux-based environments, analyze logs, and design repeatable troubleshooting methods.

You will join a team focusing on performance, stability, and diagnostics, including DCGM and NCCL benchmarks, PCIe topology, and firmware interconnects. Strong scripting in Python or Go will accelerate automation and root-cause analysis.

Qualifications

• Five+ years hands-on Linux-based systems engineering on server hardware, firmware, PCIe and GPU/HPC platforms.
• Extensive Linux troubleshooting, including kernel-level debugging.
• Strong understanding of NVIDIA GPU systems, drivers, and interconnects.
• Deep PCIe knowledge: enumeration, topology, link behavior, error types.
• Experience with BIOS/UEFI, BMC, GPU firmware and NIC firmware.
• Ability to automate investigations with Python or Go.

Responsibilities

• Form and test hypotheses by examining system logs, hardware data, and targeted diagnostic results.
• Isolate failures across GPU servers, Linux hosts, firmware, PCIe and other interconnects, power, and cooling.
• Analyze GPU diagnostics and fabric behavior, and run tests such as DCGM diagnostics and NCCL benchmarks.
• Investigate PCIe topology and errors, linking symptoms to link or signal integrity issues.
• Benchmark system performance, stability, power usage, thermal behavior, and workload characteristics.
• Document root causes and turn findings into repeatable troubleshooting procedures; automate investigations with scripts.

Skills

Linux troubleshooting

Kernel debugging

NVIDIA GPU systems

PCIe knowledge

Firmware experience

Python or Go scripting

Tools

DCGM diagnostics

NCCL benchmarks

Job description

Role overview

Investigate difficult hardware and platform failures in high-performance GPU systems, using evidence to determine whether the cause lies in the GPU, host, firmware, interconnect, cooling, or physical hardware. The role combines Linux-based systems debugging, performance and stability analysis, and the creation of repeatable troubleshooting methods for issues that may not have an established procedure.

Responsibilities

• Form and test hypotheses by examining system logs, hardware data, and targeted diagnostic results.
• Isolate failures across GPU servers, Linux hosts, firmware, PCIe and other interconnects, power, and cooling.
• Analyze GPU diagnostics and fabric behavior, and run tests such as DCGM diagnostics and NCCL benchmarks.
• Investigate PCIe topology and errors, connecting protocol-level symptoms to potential link or signal-integrity problems.
• Benchmark system performance, stability, power use, thermal behavior, and workload characteristics.
• Document root causes and turn findings into repeatable troubleshooting procedures; automate investigations with scripts.

Requirements

• At least five years of hands-on systems engineering experience involving Linux, server hardware, firmware, PCIe, and GPU or high-performance computing platforms.
• Extensive Linux troubleshooting experience, including knowledge of the kernel and kernel-level debugging.
• Strong understanding of modern server architecture and NVIDIA GPU systems, including relevant diagnostics, drivers, and interconnects.
• Deep PCIe knowledge, including enumeration, topology, link behavior, and error types.
• Experience with platform firmware such as BIOS/UEFI, BMC, programmable logic, GPU firmware, and NIC firmware.
• Practical ability to investigate hardware, software, and networking issues; use low-level interfaces such as I²C, SMBus, or PMBus; and automate work with Python or Go.

Benefits and work setup

• The listed benefits include employer-paid medical, dental, and vision coverage for employees and families.
• A retirement plan with up to a 4% employer match and immediate vesting.
• Paid parental leave.
• A monthly reimbursement of up to $85 for mobile and internet.
• Employer-paid disability and life insurance.
• The source lists a salary range of $179,500–$224,300 plus quarterly performance bonuses.