Graduate GPU AI Platform Engineer — System Optimization

ByteDance

San Jose (CA)

On-site

USD 162,000 - 317,000

Full time

32 hours ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

ByteDance is seeking a graduate-level GPU/AI Platform Architect to optimize giant model systems, including LLM workloads. You will work on architecture, validation, and performance tuning for high-performance server and storage platforms at scale in a cutting-edge hardware environment.

The role emphasizes deep system-level optimization, collaboration with industry groups, and hands-on development in C/C++ and Python, with opportunities to shape next-generation AI infrastructure.

Qualifications

  • PhD in Electrical, Computer Engineering, Computer Science or related field.
  • Thesis on GPU/AI platform architecture or co-design.
  • Deep understanding of GPU/AI SoC, interconnects and memory subsystems.
  • Experience in GPU/AI system performance optimization or HW/SW co-design.
  • Strong C/C++ and Python development skills.
  • Knowledge of GPU/AI virtualization, DL architectures and distributed systems.

Responsibilities

  • Develop application benchmarks, tools and optimization methods for GPU/AI systems including giant model training/inference.
  • Identify bottlenecks via data-driven study and drive HW/SW co-design improvements.
  • Develop GPU/AI system TCO model from benchmarks and performance data.
  • Collaborate with industry groups to explore new standards and contribute research results.
  • Coordinate with partners to set up POC or prototypes to test new designs.

Skills

C/C++
Python
GPU/AI architecture
System performance optimization
Hardware-software co-design

Education

PhD in EE/CE/CS

Tools

Git

Job description

ByteDance is seeking a graduate-level GPU/AI Platform Architect to optimize giant model systems, including LLM workloads. You will work on architecture, validation, and performance tuning for high-performance server and storage platforms at scale in a cutting-edge hardware environment.

The role emphasizes deep system-level optimization, collaboration with industry groups, and hands-on development in C/C++ and Python, with opportunities to shape next-generation AI infrastructure.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Graduate AI Model Optimization Engineer
Graduate AI Model Optimization Engineer

ByteDance • San Jose (CA)

On-site
USD 128,000 - 256,000
Graduate Production Systems Engineer – Linux, GPU & AI
Graduate Production Systems Engineer – Linux, GPU & AI

ByteDance • San Jose (CA)

On-site
USD 76,000 - 128,000
Medical, dental, vision insurance
401(k) with company match
Paid parental leave
+1
Graduate Research Scientist, AI Systems & Infrastructure
Graduate Research Scientist, AI Systems & Infrastructure

ByteDance • San Jose (CA)

On-site
USD 218,000 - 388,000
Medical, dental, vision insurance
401(k) with company match
Paid parental leave
+6
Senior GPU Production Systems Engineer
Senior GPU Production Systems Engineer

ByteDance • New York (NY)

On-site
USD 180,000 - 240,000
Graduate Backend Inference Engine Engineer
Graduate Backend Inference Engine Engineer

ByteDance • San Jose (CA)

On-site
USD 128,000 - 256,000
Medical insurance
Dental insurance
Vision insurance
+8
Graduate Production Systems Engineer - Linux, GPU & AI Ops
Graduate Production Systems Engineer - Linux, GPU & AI Ops

Pangle • San Jose (CA), Northern (KY)

Hybrid
USD 120,000 - 180,000
Graduate AI Backend Engineer - Gen AI Platform
Graduate AI Backend Engineer - Gen AI Platform

ByteDance • San Jose (CA)

On-site
USD 128,000 - 317,000
Medical insurance
Dental insurance
Vision insurance
+3
Graduate Research Engineer, AI Training Systems
Graduate Research Engineer, AI Training Systems

ByteDance • Seattle (WA)

On-site
USD 242,000 - 456,000
Large-Model Inference Runtime Engineer
Large-Model Inference Runtime Engineer

Bytedance • San Jose (CA)

On-site
USD 128,000 - 256,000
Graduate Software Engineer: AI Infrastructure & Scalable Systems
Graduate Software Engineer: AI Infrastructure & Scalable Systems

ByteDance • San Jose (CA)

On-site
USD 150,000 - 200,000