GPU/AI Application System Software Engineer Intern (System Technologies and Engineering) - 2027[...]

ByteDance; San Jose (CA); On-site; USD 55,000 - 69,000; Full time

Benefits offered by this job

Health insurance

Housing allowance

12 paid holidays per year

Job summary

ByteDance is seeking a campus intern in San Jose to join the GPU/AI System Technology and Engineering Team. You will design and implement performance benchmarks and testing methodologies to evaluate OS and hardware system performance, and develop Python scripts to automate tests for AI workloads and HPC.

You will collaborate across teams to identify bottlenecks and optimize performance. Ideal candidates are pursuing a Bachelor's or Master's in Computer/Electrical Engineering or Computer Science,

Qualifications

• Pursuing a Bachelor's or Master's degree in related fields.

Responsibilities

• Design and implement performance benchmarks and testing methodologies for OS/kernel/Hardware system factors.
• Develop benchmark tools and optimize AI workloads for large-scale LLM training and HPC.
• Develop Python scripts to automate testing of benchmark tools.
• Collaborate with internal teams to identify bottlenecks and improve performance.

Skills

Operating System understanding

Linux kernel

Computer architecture

GPU/CPU benchmarking

ML/DL frameworks (TensorFlow/PyTorch)

Testing automation

Linux based systems

Parallel benchmarking/OS impact

Education

Bachelor's or Master's in Computer Engineering / Electrical Engineering / Computer Science or related

Tools

Python scripting

Job description

Responsibilities

About the Team:

The GPU/AI System Technology and Engineering Team is committed to developing highly optimized OS and system software to support deep learning and high-performance computing (HPC) workloads in large-scale data centers.

We focus on delivering core software components for the next generation of AI and HPC platforms, benchmarks, and fine-tuning performance. Our work spans the entire hardware/software stack, from GPU drivers to deep learning frameworks, to ensure peak performance across all layers.

By joining this team, you will work with the best engineers and talents in this industry and have a broad opportunity to get in touch with the latest AI application systems and newly emerged technology in computing, networking and storage. You will gain remarkable GPU architecture, system software development and GPU validation experience in the most advanced hardware infrastructure on a massive scale.

• Design and implement performance benchmarks and testing methodologies to evaluate system performance （especially for those factors impacted most closely to OS, OS kernel, Hardware System）
• Develop benchmark tools and performance optimization of AI workloads specifically tailored for large-scale LLM training and inference, as well as High-Performance Computing (HPC).
• Develop Python scripts to automate the testing of various benchmark tools.
• Collaborate with internal teams to identify system bottleneck, debug and improve performance issues.

Qualifications

Minimum Qualifications:

• Currently pursuing a Bachelor's or Master's degree within Computer Engineering in Electrical Engineering, Computer Engineering, Computer Science or related majors.
• Deep understanding of Operating System, Linux Kernel, Computer Architecture
• Background with GPU/CPU benchmarking
• Familiar with ML/DL techniques, algorithms and frameworks like TensorFlow or PyTorch.
• Exposure to testing automation for various applications.
• Hands-on experience with Linux based systems

Preferred Qualifications

• Strong background in one of the following fields: High Performance Computing, ML Hardware Acceleration (e.g., GPU/TPU/RDMA) or ML for Systems, and Distributed Storage.
• Experience in AI model development, training, evaluation and deployment on Cloud, Cluster or on-premises.
• Experience with parallel programming and at least one communication runtime (MPI, NCCL, UCX, NVSHMEM)
• Linux kernel development experience, such as networking and device drivers etc.
• Exposure to testing automation for various applications.
• Experience with complex system-level debugging is invaluable.

Job Information

【For Pay Transparency】Compensation Description (Hourly) - Campus Intern

The hourly rate range for this position in the selected city is $45- $45.

Benefits may vary depending on the nature of employment and the country work location. Interns have day one access to health insurance, life insurance, wellbeing benefits and more. Interns also receive 10 paid holidays per year and paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year). Interns who are not working 100% remote may also be eligible for housing allowance.

The Company reserves the right to modify or change these benefits programs at any time, with or without notice.

For Los Angeles County (unincorporated) Candidates

• Interacting and occasionally having unsupervised contact with internal/external clients and/or colleagues;
• Appropriately handling and managing confidential information including proprietary and trade secret information and access to information technology systems; and
• Exercising sound judgment.

About Us

Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join ByteDance

Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.

As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.

Diversity & Inclusion

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.

Reasonable Accommodation

ByteDance is committed to providing reasonable accommodations in our recruitment processes for candidates with disabilities, pregnancy, sincerely held religious beliefs or other reasons protected by applicable laws. If you need assistance or a reasonable accommodation, please reach out to us at https://tinyurl.com/RA-request