AI SoC Architect Networking

Socket.dev

Los Altos (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Majestic Labs seeks a highly technical SOC System Network Architect for AI, leading the definition and design of network engines and interconnect fabrics powering our custom AI servers.

You will work with silicon, hardware, firmware, and software teams to optimize scale-up and scale-out networks for distributed AI workloads, including RDMA, NIC engines, and advanced transport protocols.

Qualifications

  • 7+ years in hands-on network architecture, SoC interconnects, or silicon engineering.
  • B.Sc. or M.Sc. in Electrical Engineering, Computer Engineering, or Computer Science.
  • Proven track record delivering complex network ASICs, NIC engines, or switch architectures.

Responsibilities

  • Architect end-to-end SoC networking engines, NIC architectures, and switch IPs for AI accelerators.
  • Define scale-up and scale-out network topologies for AI workloads.
  • Design hardware acceleration and offload engines for AI collectives on the network fabric.
  • Optimize transport protocols and congestion control for synchronized AI traffic flows.
  • Drive performance modeling, cycle-accurate simulations, and traffic analysis.
  • Collaborate across ASIC design, silicon architecture, firmware, and software teams.
  • Produce network architecture specs and lead architecture reviews.

Skills

SoC networking
Network architecture
RDMA (RoCEv2)
SmartNIC/NIC
TCP/UDP/IP
Performance modeling
Hardware/software interfaces

Education

B.Sc./M.Sc. in Electrical/Computer Engineering/CS

Tools

ns-3
OMNeT++
SystemC/TLM
Verilog

Job description

About Majestic Labs

We’re a fast-moving, US-Israeli AI startup building next-generation infrastructure for the world’s most demanding AI workloads. Our mission is to accelerate the future of intelligence and make it ubiquitously accessible by delivering full stack custom AI servers optimized for large-scale inference and training.

Backed by top-tier investors and led by industry veterans, we’re scaling rapidly. We seek forward-thinking engineers and operators who thrive in a collaborative environment and excel at solving complex challenges from first principles. If you want to build infrastructure that fundamentally changes what the world can accomplish with AI, come join us!

About the position

This is a highly technical and cross-functional role requiring deep expertise in SoC networking, high-speed interconnects, and protocol acceleration for AI. As a SOC System Network Architect for AI, you will lead the definition and architectural design of network engines and interconnect fabrics powering our custom AI servers. You will collaborate closely with silicon architecture, hardware design, firmware, and software teams to shape scale-up and scale-out networking topologies optimized for distributed AI workloads.

Responsibilities

  • Architect end-to-end SoC networking engines, SmartNIC/NIC architectures, and switch interface IPs for AI accelerators
  • Define scale-up (intra-node) and scale-out (inter-node) network topologies
  • Design hardware acceleration and offload engines for AI collective operations (e.g., AllReduce, AllGather, AllToAll) directly on the network fabric
  • Optimize transport protocols (RoCEv2, custom RDMA engines, TCP/UDP offloads) and adaptive routing/congestion control algorithms (e.g., DCQCN) for synchronized AI traffic flows
  • Drive performance modeling, cycle-accurate simulations, and traffic pattern analysis to evaluate architectural trade-offs across network fabrics
  • Collaborate with ASIC design, silicon architecture, and AI software teams to define hardware/software interfaces, register abstractions, and programming models
  • Produce high-quality network architecture specifications, interface documents, and lead cross-functional architecture reviews
Requirements
  • 7+ years of hands-on network architecture, SoC interconnect design, or silicon engineering experience, with at least 3 years in an architecture or technical lead capacity
  • B.Sc. or M.Sc. in Electrical Engineering, Computer Engineering, or Computer Science
  • Proven track record of owning and delivering complex network ASICs, NIC engines, or switch architectures from initial concept through silicon bring-up

Core Technical Skills

  • Deep expertise in SmartNIC/NIC architecture, RDMA technologies (RoCEv2, InfiniBand), and hardware transport protocol engines
  • Strong understanding of scale-up and scale-out topologies, high-speed packet processing, and switch architecture trade-offs
  • In-depth knowledge of AI communication patterns and hardware acceleration for network collective operations
  • Solid foundation in lower-level network protocols (TCP/UDP, Ethernet, IP) and advanced network congestion control mechanisms
  • Proficiency in network performance modeling, hardware simulation tools, and architectural trade-off analysis

Preferred Qualifications

  • Experience with high-speed proprietary interconnects (e.g., NVLink, NVSwitch, UALink, CXL) or custom switch silicon
  • Hands-on experience with network simulation and modeling frameworks (e.g., ns-3, OMNeT++, SystemC/TLM)
  • Familiarity with distributed AI communication libraries (e.g., NCCL, RCCL) and frameworks (PyTorch, DeepSpeed)

At Majestic Labs, we are shaping the next paradigm and making AI ubiquitous by building radically better infrastructure across the entire stack-from systems engineering and VLSI to compilers and AI applications. This epic mission requires a relentless culture of innovation, grit, and dedication. Our employees are our most important asset.

Have you read the job description and feel you could be a great fit?

We seek smart, curious, self-driven individuals who enjoy creative problem-solving and continuous learning. Even if you don\'t meet all requirements, we\'d love to hear from you if you have the mindset to tackle complex challenges.

Majestic Labs is an equal opportunity employer deeply committed to diversity of background and thought. If you are ready to dare greatly, learn from mistakes, engage in vigorous debates, and help create a step-function shift in human technical capability-we want to meet you!

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

SoC Management Subsystem Architect
SoC Management Subsystem Architect

Majestic Labs ai • Los Altos (CA)

On-site
USD 180,000 - 260,000
AI SoC Networking Architect: Scale-Out & RDMA Expert
AI SoC Networking Architect: Scale-Out & RDMA Expert

Socket.dev • Los Altos (CA)

On-site
USD 180,000 - 260,000
Signal Integrity & Power Integrity Engineer
Signal Integrity & Power Integrity Engineer

Socket.dev • Los Altos (CA)

On-site
USD 150,000 - 190,000
Technical Support Senior Staff Engineer
Technical Support Senior Staff Engineer

Upscale AI • United States

On-site
USD 200,000 - 216,000
Microarchitect / RTL Design - On-Chip Interconnect & High-Speed Fabric Design
Microarchitect / RTL Design - On-Chip Interconnect & High-Speed Fabric Design

Architect Labs • Palo Alto (CA), Northern (KY)

Hybrid
USD 210,000 - 360,000
Senior RTL Engineer, Interconnect Design
Senior RTL Engineer, Interconnect Design

OpenAI • San Francisco (CA)

Hybrid
USD 130,000 - 180,000
Relocation assistance
Hybrid work model
Mentorship opportunities
Microarchitect / RTL Design - Interconnect & Fabric
Microarchitect / RTL Design - Interconnect & Fabric

Architect Labs • Palo Alto (CA)

On-site
USD 210,000 - 320,000
System Firmware Architect
System Firmware Architect

Socket.dev • Los Altos (CA)

On-site
USD 150,000 - 210,000
Member of Technical Staff — On-Chip Interconnect & High-Speed Fabric Design
Member of Technical Staff — On-Chip Interconnect & High-Speed Fabric Design

Kindredventures • Palo Alto (CA)

On-site
USD 260,000 - 420,000
Technical Support Principal Engineer – AI Network
Technical Support Principal Engineer – AI Network

Upscale AI • United States

On-site
USD 248,000 - 269,000