Senior GPU Production Systems Engineer

ByteDance; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

ByteDance is seeking a Senior Production Systems Engineer to lead the introduction and productionization of high-density GPU infrastructure across its global data centers. You will own platform evaluation, system integration, and fleet onboarding, working closely with AI training and inference environments.

The role demands deep expertise in Linux, hardware lifecycle, and automation, with strong program management and cross-team collaboration across international sites.

Qualifications

• Bachelor’s degree or equivalent in a related field with 5+ years in production systems or large-scale data center ops.
• Hands-on experience introducing and productionizing large-scale GPU infrastructure on modern platforms.
• Strong Linux administration, hardware lifecycle, firmware, and driver knowledge.
• Experience with containerized AI workloads and orchestration tooling.

Responsibilities

• Lead evaluation, qualification, and production rollout of next-gen GPU platforms and rack-scale AI infra.
• Define launch criteria, readiness plans for hardware, firmware, OS, drivers, and tooling.
• Coordinate across data centers, network, power, cooling, and vendors for fleet readiness.
• Diagnose complex Linux/hardware issues and develop burn-in, benchmarking, and health-check pipelines.
• Build scalable automation and telemetry for provisioning, monitoring, and remediation.
• Provide cross-functional leadership and mentor engineers on global infra programs.
• Participate in global on-call rotations and lead incident investigations.

Skills

GPU infrastructure

Linux administration

Automation

Python

Incident response

Distributed systems

Education

Bachelor's degree in CS/CE/EE or equivalent

Tools

NVIDIA GPUs

BMC/IPMI/Redfish

Containerization (Docker, Kubernetes)

Job description

ByteDance is seeking a Senior Production Systems Engineer to lead the introduction and productionization of high-density GPU infrastructure across its global data centers. You will own platform evaluation, system integration, and fleet onboarding, working closely with AI training and inference environments.

The role demands deep expertise in Linux, hardware lifecycle, and automation, with strong program management and cross-team collaboration across international sites.