Software Engineer, ML System Architecture

ByteDance; Seattle (WA); On-site; USD 129,960 - 246,240; Full time

Benefits offered by this job

Medical/dental/vision benefits

401(k) with company match

Paid time off

Job summary

A leading tech company in Seattle is seeking a Software Engineer for ML System Architecture. The role involves designing and developing machine learning infrastructure and large-scale systems. Ideal candidates are proficient in multiple programming languages and have experience with distributed systems. This position offers competitive compensation and comprehensive benefits.

Qualifications

• Proficient in 1 to 2 programming languages in a Linux environment.
• Experience in large-scale ML systems design, development, and maintenance.
• Familiarity with AI Infrastructure and HW/SW Co-Design.

Responsibilities

• Design and develop Machine Learning infrastructure for LLM/AIGC.
• Build a super large machine learning system integrating GPUs and networking.
• Address technical problems for system stability and availability.

Skills

Proficient in C++/Go/Python/Shell

Understanding of distributed systems

Familiar with Kubernetes architecture

Strong logical analysis and communication

Job description

Overview

Software Engineer, ML System Architecture

Responsibilities

• Responsible for the design and development of Machine Learning infrastructure for LLM/AIGC, etc.
• Build a super large machine learning system integrating GPUs, RDMA networking, and high-performance storage.
• Address technical problems to ensure high stability and availability of the system.
• Organize and coordinate multiple teams to complete system construction (Data center, network, computing, storage, resource teams).

Qualifications

• Minimum: Proficient in 1 to 2 programming languages (C++/Go/Python/Shell) in a Linux environment.
• Understanding of distributed systems with experience in large-scale ML systems design, development, and maintenance.
• Familiar with Kubernetes architecture and system-level development and tuning.
• Strong logical analysis, ability to abstract and split business logic; good communication and self-drive.
• Preferred: Experience with ML infrastructure for large model training and inference; experience in AI Infrastructure, HW/SW Co-Design, HPC, ML hardware architecture (GPU, accelerators, networking).

About Doubao (Seed)

Founded in 2023, the ByteDance Doubao (Seed) Team pioneers advanced AI foundation models. Our goal is to lead in cutting-edge research and drive technological and societal progress. Research areas span deep learning, reinforcement learning, language, vision, audio, AI Infra and AI Safety, with labs and positions across China, Singapore, and the US.

Why Join ByteDance

ByteDance values creativity and authentic expression. Our diverse global teams work to create value for communities and users. We cultivate curiosity, humility, and an "Always Day 1" mindset to achieve meaningful breakthroughs for our people, company, and users.

Diversity & Inclusion

ByteDance is committed to an inclusive space where employees are valued for their skills, experiences and perspectives. We celebrate diverse voices and aim to reflect the communities we reach.

Reasonable Accommodation

ByteDance provides reasonable accommodations in recruitment for candidates with disabilities, pregnancy, sincerely held religious beliefs or other protected reasons. If you need assistance, please reach out at https://tinyurl.com/RA-request

Job Information

Compensation: The base salary range for this position in the selected city is $129,960 - $246,240 annually. Total Package may include discretionary bonuses, incentives, and RSUs. Benefits include medical/dental/vision, 401(k) with company match, parental leave, disability coverage, life insurance, wellbeing benefits, and paid time off. Benefits vary by location and employment type. Company reserves the right to modify benefits at any time.