Software Engineer, Compute Performance

engineeringjobs.net, Inc.; San Jose (CA); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401(k) Matching

Paid Parental Leave

Short-Term Disability Coverage

Long-Term Disability Coverage

Life Insurance

Restricted Stock Units

Paid Holidays

Floating Holiday

Birthday Leave

Year-End Holiday Shutdown

Personal Wellness Days

Paid Vacation

Sick Leave

Family Emergency Leave

Paid Volunteer Days

Annual Bonus

Job summary

engineeringjobs.net, Inc. is seeking an experienced engineer to run and analyze AI training, inference, and HPC workloads on GPU-accelerated systems.

You will use telemetry and profiling tools to identify bottlenecks across compute, memory, interconnect, and storage, and document procedures and results. You will build automation for performance testing, regression detection, and failure triage, and collaborate with hardware and software teams to resolve issues.

Qualifications

• Requires degree with related experience or equivalent work history.
• Linux systems debugging, testing, or tuning experience.
• Experience evaluating AI, ML, or HPC workloads.
• 3+ years with a programming or scripting language.

Responsibilities

• Run and analyze AI training, inference, and HPC workloads on GPU-accelerated systems.
• Use telemetry and profiling tools to identify bottlenecks across compute, memory, interconnect, and storage.
• Build automation for performance testing, regression detection, and failure triage.
• Collaborate with hardware and software teams to resolve issues.
• Document procedures and results.

Skills

Linux Systems Debugging

AI Workload Performance Analysis

HPC Workloads

Python

C

C++

Go

Bash

GPU Computing

CUDA

ROCm

NCCL

RCCL

Performance Profiling

Kubernetes

Slurm

Education

Bachelor's degree

Master's degree

PhD with relevant research

Equivalent work experience

Tools

Kubernetes

Slurm

Job description

Run and analyze AI training, inference, and HPC workloads on GPU-accelerated systems, using telemetry and profiling tools to identify compute, memory, interconnect, storage, and scaling bottlenecks. Build automation for performance testing, regression detection, and failure triage, collaborate with hardware and software teams to resolve issues, and document procedures and results.

Requirements: Requires a bachelor’s degree and at least five years of related experience, a master’s degree and at least three years, a PhD with relevant research experience, or equivalent work experience. Candidates need Linux systems debugging, testing, or tuning experience; experience evaluating AI, machine learning, or HPC workloads; and at least three years with a programming or scripting language, while GPU technologies, profiling tools, distributed workload environments, and GPU system architecture are preferred.

Key Skills: Linux Systems Debugging, AI Workload Performance Analysis, HPC Workloads, Python, C, C++, Go, Bash, GPU Computing, CUDA, ROCm, NCCL, RCCL, Performance Profiling, Kubernetes, Slurm

Benefits: Medical Insurance, Dental Insurance, Vision Insurance, 401(k) Matching, Paid Parental Leave, Short-Term Disability Coverage, Long-Term Disability Coverage, Life Insurance, Restricted Stock Units, Paid Holidays, Floating Holiday, Birthday Leave, Year-End Holiday Shutdown, Personal Wellness Days, Paid Vacation, Sick Leave, Family Emergency Leave, Paid Volunteer Days, Annual Bonus