AI Infrastructure Lead & Research Architect

ByteDance; San Jose (CA); On-site; USD 244,800 - 450,000; Full time

Benefits offered by this job

Medical insurance

401(k) match

Parental leave

Wellbeing benefits

Paid holidays

PTO

Job summary

ByteDance in San Jose is seeking an experienced Research Scientist/Engineer to define and build the next generation of AI infrastructure. You will work at the intersection of large-scale systems, AI, and hardware to design scalable, reliable AI workloads across the full stack.

The role involves tracking AI trends, prototyping architectures, and driving innovations in memory systems and performance. Collaboration with leaders and product teams is essential to translate requirements into robust

Qualifications

• PhD in CS, CE, EE or related field; cognitive science background welcomed with strong systems fundamentals.
• Experience with distributed systems, infrastructure engineering, or ML systems and evaluating trade-offs across hardware, software, etc.
• Proficient in integrating AI tools into research workflows.
• Demonstrated ability to learn quickly in fast-evolving tech horizons.
• Excellent cross-team communication skills.

Responsibilities

• Design and evaluate scalable AI factory architectures for large-scale training, RL, and inference workloads.
• Develop technical proposals considering supply-chain and energy constraints alongside silicon/software trade-offs.
• Track emerging AI system trends and build prototypes; share insights via technical reports.
• Analyze and optimize ML stack performance across scheduling, networking, storage, and memory systems.
• Collaborate across research, engineering, hardware, and product teams to translate workloads into scalable solutions.

Skills

PhD in CS/CE/EE

Distributed systems

ML systems

AI tooling integration

Collaborative communication

Education

PhD in CS/EE

Tools

RDMA

NCCL

Job description

ByteDance in San Jose is seeking an experienced Research Scientist/Engineer to define and build the next generation of AI infrastructure. You will work at the intersection of large-scale systems, AI, and hardware to design scalable, reliable AI workloads across the full stack.

The role involves tracking AI trends, prototyping architectures, and driving innovations in memory systems and performance. Collaboration with leaders and product teams is essential to translate requirements into robust