Head of Edge GPU Infrastructure & Compute

Montauk Capital

New York (NY)

On-site

USD 120,000 - 160,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Equity options
Studio support from Montauk Capital

Job summary

Montauk Capital seeks an experienced Infrastructure Engineer in New York to lead GPU infrastructure and manage hardware selections. This role focuses on the design, implementation, and operational maintenance of a metro edge compute platform. You will work on GPU provisioning, automate monitoring, and scale deployments in real-world environments, thereby addressing the AI inference bottleneck and contributing to transformative tech at the edge.

Qualifications

  • Strong infrastructure engineer experienced with hardware deployment.
  • Experience managing compute infrastructure in real-world environments.
  • Ownership of GPU provisioning and hardware selection.

Responsibilities

  • Own GPU infrastructure design and implementation.
  • Manage deployments at production scale.
  • Build automation and monitoring stack for distributed edge nodes.

Skills

Infrastructure engineering
GPU provisioning
Deployment planning
Linux systems
Networking fundamentals
Operational troubleshooting

Education

Experience in data center environments

Tools

RHEL/Ubuntu
IPMI/Redfish
BMC-based remote management

Job description

Montauk Capital seeks an experienced Infrastructure Engineer in New York to lead GPU infrastructure and manage hardware selections. This role focuses on the design, implementation, and operational maintenance of a metro edge compute platform. You will work on GPU provisioning, automate monitoring, and scale deployments in real-world environments, thereby addressing the AI inference bottleneck and contributing to transformative tech at the edge.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Infrastructure Engineer, Perimeter Compute
Infrastructure Engineer, Perimeter Compute

Montauk Capital • New York (NY)

On-site
USD 120,000 - 160,000
Competitive compensation
Equity options
Studio support from Montauk Capital
Head of GPU Infrastructure & HPC Engineering
Head of GPU Infrastructure & HPC Engineering

Greylock Partners • New York (NY)

On-site
USD 210,000 - 320,000
Technical Staff: Edge GPU Infra & Production
Technical Staff: Edge GPU Infra & Production

Perimeter Compute Inc • United States

Remote
USD 120,000 - 180,000
Health, dental and vision insurance
Unlimited PTO
$500 home office stipend
+2
Head of GPU Cloud Infrastructure & HPC
Head of GPU Cloud Infrastructure & HPC

Energy Jobline ZR • Mundelein (IL)

On-site
USD 180,000 - 290,000
Senior GPU Systems Engineer: Scale AI Clusters & HPC
Senior GPU Systems Engineer: Scale AI Clusters & HPC

Career Techniques • New York (NY)

Hybrid
USD 200,000 - 300,000
Senior Engineer, GPU Fleet Automation & Ops
Senior Engineer, GPU Fleet Automation & Ops

NVIDIA • New York (NY)

On-site
USD 308,000 - 471,500
Equity
Benefits
Head of Compute Economics & GPU Infrastructure
Head of Compute Economics & GPU Infrastructure

Cognichip • Redwood City (CA)

On-site
USD 180,000 - 300,000
Early-stage equity
Competitive compensation package
Collaborative culture
Senior GPU Network Operations Engineer (AI Data Centers)
Senior GPU Network Operations Engineer (AI Data Centers)

GMI Cloud, Inc • United States

On-site
USD 120,000 - 180,000
AI Infra Engineer: Edge GPU Scheduling & Deployment
AI Infra Engineer: Edge GPU Scheduling & Deployment

Maxta, Inc. • California

Hybrid
USD 120,000 - 150,000
Competitive salary
Equity
Full benefits package
+2
Senior Edge AI Engineer: Agentic GPU Deployment
Senior Edge AI Engineer: Agentic GPU Deployment

Segment (Twilio) • Santa Clara (CA)

On-site
USD 152,000 - 287,500
Equity
Benefits package