Founding Network Engineer for AI Inference Data Center

General Compute

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

General Compute is building a dedicated data center network to support its heterogeneous accelerator fleet for AI/HPC workloads. You will design and deploy the entire network fabric, ensuring high bandwidth, low latency, and secure multi-tenant connectivity across sites.

As an early hire at a 6–7 person company, you will tackle diverse challenges from cable routing to vendor management, shaping the backbone that powers inference across our fleet.

Qualifications

  • Hands-on design and deployment of data center networks.
  • Deep routing and switching knowledge for modern DC fabrics.
  • Experience building high-performance networks for AI/HPC clusters or latency-critical environments.
  • Network automation skills (Python, Ansible) and treating config as code.
  • Comfort on the data center floor handling cabling and hardware issues.
  • Comfort with hardware heterogeneity and ambiguity.
  • Genuine interest in being an early hire at a ~6–7 person company.

Responsibilities

  • Design and own the data center network architecture: leaf-spine fabric, high-bandwidth, low-latency paths between GPU prefill and ASIC decode systems, and out-of-band management.
  • Lead the network build-out for each new site: BOMs, rack elevations, cabling, cross-connects, and bring-up through acceptance testing.
  • Translate accelerator vendor networking requirements into a single consistent fleet design.
  • Set up external connectivity: IP transit, peering, and private connections to customers.
  • Build tenant isolation and network security from day one.
  • Automate configuration, provisioning, and validation against a single source of truth.
  • Build monitoring and telemetry for the fabric, and own network incident response.
  • Manage network hardware vendors, carriers, colocation providers, remote hands teams.
  • Collaborate with platform team; own L2/L3 network, fabric performance, site connectivity; hand off to platform for fleet-wide routing.

Skills

DC network design
BGP/EVPN-VXLAN/ECMP
AI/HPC network experience
Network automation (Python/Ansible)
On-site cabling & hardware fault-fix
Hardware heterogeneity
Startup mindset

Tools

NetBox
Nautobot
gNMI

Job description

General Compute is building a dedicated data center network to support its heterogeneous accelerator fleet for AI/HPC workloads. You will design and deploy the entire network fabric, ensuring high bandwidth, low latency, and secure multi-tenant connectivity across sites.

As an early hire at a 6–7 person company, you will tackle diverse challenges from cable routing to vendor management, shaping the backbone that powers inference across our fleet.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Founding Network Engineer
Founding Network Engineer

General Compute • San Francisco (CA)

On-site
USD 180,000 - 260,000
Founding Platform Engineer — AI Inference Cloud
Founding Platform Engineer — AI Inference Cloud

General Compute • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior Data Center Networking & Infra Engineer
Senior Data Center Networking & Infra Engineer

Deep Infra Inc. • Palo Alto (CA)

On-site
USD 180,000 - 210,000
Founding AI Inference Architect
Founding AI Inference Architect

General Compute • San Francisco (CA)

On-site
USD 180,000 - 320,000
Networking Engineer - AI Data Center Fabric
Networking Engineer - AI Data Center Fabric

Tensordyne • Sunnyvale (CA)

On-site
USD 150,000 - 210,000
Comprehensive benefits
Flexible spending options
Recognition program
Senior AI Infra Network Engineer (Datacenter/GPU) (Equity)
Senior AI Infra Network Engineer (Datacenter/GPU) (Equity)

QumulusAI • United States

On-site
USD 100,000 - 130,000
Competitive compensation
Equity participation
Opportunity to work on cutting-edge technology
Staff Datacenter Networking Engineer: Frontier AI GPU
Staff Datacenter Networking Engineer: Frontier AI GPU

Prime Intellect • San Francisco (CA)

On-site
USD 150,000 - 300,000
Senior Network Engineer — AI Cloud Networking & Automation
Senior Network Engineer — AI Cloud Networking & Automation

Nscale • New York (NY), San Francisco (CA), Seattle (WA)

On-site
USD 140,000 - 190,000
AI Network Engineer
AI Network Engineer

AMSYS Innovative Solutions, LLC • Houston (TX)

On-site
USD 150,000 - 190,000
Principal AI Cloud Data Center Networking Architect
Principal AI Cloud Data Center Networking Architect

Designworks Talent LLC • Bellevue (WA)

Hybrid
USD 180,000 - 240,000
Medical, dental, and vision insurance
401(k) with company match
Paid holidays