Lead GPU System Software Architect for Data-Center Compute

ByteDance

San Jose (CA)

On-site

USD 230,000 - 280,000

Full time

7 days ago
Be an early applicant
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

ByteDance in San Jose is seeking a hands-on leader to drive the low-level GPU software stack for data-center compute. You will define architecture, set technical standards, and guide cross-functional teams across silicon, firmware, kernel, runtimes, and fleet management.

You will remain deeply involved through prototyping, critical-path reviews, performance analysis, and high-severity investigations, communicating decisions to engineers and executives alike.

Qualifications

  • Bachelor's degree in CS/CE/EE or equivalent practical experience.
  • 5+ years hands-on GPU/accelerator/kernel/system software with leadership on complex hardware/software programs.
  • Proven ability to lead hardware/software programs from concept to production.
  • Deep understanding of accelerator architecture, memory, interconnects, OS, device management, and reliability.
  • Experience coordinating dependencies across multiple engineering teams.
  • Strong coding, design review, performance analysis, and debugging with hands-on contributions.

Responsibilities

  • Define architecture and multi-year technical roadmap for GPU system software across driver, runtime, firmware-interface, management, observability, and reliability layers.
  • Set priorities and standards for accelerator enablement balancing product commitments with compatibility, performance, serviceability, and long-term maintenance.
  • Own end-to-end integration from architecture and pre-silicon planning through bring-up, qualification, GA, fleet monitoring, and sustained operation.
  • Lead cross-functional execution among silicon, firmware, kernel, compiler, library, ML framework, server, network, storage, validation, and production teams.
  • Resolve ambiguous system-level tradeoffs involving APIs, resource management, memory and interconnect topology, telemetry, recovery, security, and workload performance.
  • Remain technically involved through prototypes, critical-path code and design reviews, performance analysis, and leadership during high-severity failure investigations.
  • Define measurable release and reliability criteria, including qualification coverage, regression thresholds, fault containment, automated repair, and fleet-health indicators.
  • Mentor engineers, raise the quality of architecture and debugging practices, and communicate technical decisions to both specialist and executive audiences.

Skills

GPU software leadership
Hands-on system debugging
Performance analysis
Cross-team coordination
Architecture guidance

Education

Bachelor's degree in CS/CE/EE

Tools

Kernel drivers
Observability tooling

Job description

ByteDance in San Jose is seeking a hands-on leader to drive the low-level GPU software stack for data-center compute. You will define architecture, set technical standards, and guide cross-functional teams across silicon, firmware, kernel, runtimes, and fleet management.

You will remain deeply involved through prototyping, critical-path reviews, performance analysis, and high-severity investigations, communicating decisions to engineers and executives alike.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Linux Kernel Architect for GPU Platforms
Lead Linux Kernel Architect for GPU Platforms

ByteDance • San Jose (CA)

On-site
USD 180,000 - 240,000
Senior GPU Systems Engineer: Kernel & Performance
Senior GPU Systems Engineer: Kernel & Performance

ByteDance • San Jose (CA)

On-site
USD 180,000 - 240,000
Senior GPU Infrastructure Production Engineer
Senior GPU Infrastructure Production Engineer

Bytedance • New York (NY)

On-site
USD 122,000 - 272,000
Medical, dental and vision insurance
401(k) with company match
Paid parental leave
+1
Lead GPU Embedded Systems Engineer
Lead GPU Embedded Systems Engineer

Google • Sunnyvale (CA)

On-site
USD 207,000 - 300,000
Lead GPU Systems & Fabric Architect for AI Cloud
Lead GPU Systems & Fabric Architect for AI Cloud

Bitdeer Technologies Group • San Jose (CA)

On-site
USD 180,000 - 240,000
Lead Vector Compute Architect — GPU/Performance Lead (Equity)
Lead Vector Compute Architect — GPU/Performance Lead (Equity)

Bolt Graphics, Inc. • Sunnyvale (CA)

On-site
USD 230,000 - 290,000
Medical, Dental & Vision
Stock Options
Senior GPU Power & DVFS System Software Lead - Equity
Senior GPU Power & DVFS System Software Lead - Equity

NVIDIA AI • Santa Clara (CA)

On-site
USD 180,000 - 240,000
Equity
Health Insurance
Inclusive Work Environment
Lead GPU HPC Cluster Architect
Lead GPU HPC Cluster Architect

Remote Worker LTD. • United States

Remote
USD 150,000 - 230,000
Gympass
Annual leave 25 days
Learning time
+3
Senior GPU Compute Cluster Architect
Senior GPU Compute Cluster Architect

Blue Signal Search • San Francisco (CA)

On-site
USD 150,000 - 230,000
Staff Software Engineer, Compute Control Plane (GPU/CPU)
Staff Software Engineer, Compute Control Plane (GPU/CPU)

Cloudjobs • San Jose (CA)

On-site
USD 180,000 - 280,000
Cash compensation
Equity compensation
Health insurance
+6