AI/LLM Network Software Engineer (High-Speed DC)

TikTok; Seattle (WA); On-site; USD 207,000 - 368,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Paid parental leave

Job summary

TikTok's Networking team designs, builds, and operates global, intelligent network infrastructure to meet requirements of high availability, scalability, and high performance for AI/LLM workloads. The role involves designing, implementing, and deploying high-speed network technologies to support AI/LLM applications.

You will work on platforms for monitoring and diagnosing large-scale AI networks, and contribute to RDMA, congestion control, and host-network-application co-design to improve

Qualifications

• Bachelor or higher degree in computer science, electronic engineering, network engineering or related fields.
• Proficiency in computer network and network programming.
• Proficiency in one or several mainstream programming languages, including C/C++, Python, Go and so on.
• Be familiar with the latest advances in the area of high-speed network systems, including RDMA, congestion control, AI network optimization and so on.
• Experience in developing high performance communication frameworks(including NCCL, MPI and RPC libraries) is a plus.
• Experience in developing software systems for AI network diagnosis and performance optimization is a plus.

Responsibilities

• Design, implementation and deployment of high-speed network technologies to support AI/LLM applications.
• Design and development of platforms/systems for monitoring, analysis and diagnosis of large scale AI/LLM network.
• Research and development of high-performance AI communication framework, network protocol stacks, and codesign optimization of host-network-application to improve the scalability, reliability and performance of AI/LLM network.
• Building next generation AI network infrastructure supporting large scale heterogeneous network hardware with innovative and deployable solutions.

Skills

Network programming

C/C++

Python

Go

RDMA

Congestion control

AI network optimization

NCCL

MPI

RPC libraries

Education

Bachelor's degree or higher in CS/EE/Network Eng

Tools

NCCL

MPI

RPC libraries

Job description

TikTok's Networking team designs, builds, and operates global, intelligent network infrastructure to meet requirements of high availability, scalability, and high performance for AI/LLM workloads. The role involves designing, implementing, and deploying high-speed network technologies to support AI/LLM applications.

You will work on platforms for monitoring and diagnosing large-scale AI networks, and contribute to RDMA, congestion control, and host-network-application co-design to improve