Senior GPU Infrastructure Production Engineer

Bytedance; New York (NY); On-site; USD 122,000 - 272,000; Full time

Benefits offered by this job

Medical, dental and vision insurance

401(k) with company match

Paid parental leave

Paid holidays and personal time

Job summary

ByteDance seeks a Senior Production Systems Engineer to lead the introduction and productionization of large-scale GPU infrastructure across data centers in the United States and Europe. You will own platform evaluation, system integration, and fleet onboarding for high-density GPU systems.

This role requires hands-on engineering, strong Linux and hardware lifecycle expertise, and the ability to coordinate across hardware, data center, network, and vendor teams.

Qualifications

• Bachelor’s degree in CS/CE/EE or equivalent with 5+ years in production systems.
• Hands-on experience introducing and productionizing large-scale GPU infrastructure.
• Deep knowledge of Linux administration and server hardware management.
• Experience with containerized AI workloads using CUDA and NCCL.
• Python/Go/Bash for production automation and strong English communication.

Responsibilities

• Lead evaluation and production rollout of next-gen GPU platforms (GB200/GB300, Vera Rubin, etc.).
• Define readiness plans for server hardware, firmware, drivers, and software stacks.
• Coordinate across hardware, data center, network, storage, and vendor teams.
• Diagnose Linux/hardware issues and develop testing/validation frameworks.
• Build automation and telemetry for provisioning, monitoring, and remediation.
• Lead on-call and incident response; travel to facilities as needed.

Skills

GPU infrastructure

Linux administration

Production systems

Python

Go

Bash

English proficiency

System architecture

Automation

Incident triage

Education

Bachelor’s degree in CS/CE/EE or related field

Tools

Redfish

BMC

BIOS/UEFI

PCIe

CUDA

NCCL

GB200/GB300

Job description

ByteDance seeks a Senior Production Systems Engineer to lead the introduction and productionization of large-scale GPU infrastructure across data centers in the United States and Europe. You will own platform evaluation, system integration, and fleet onboarding for high-density GPU systems.

This role requires hands-on engineering, strong Linux and hardware lifecycle expertise, and the ability to coordinate across hardware, data center, network, and vendor teams.