Head of Edge GPU Infrastructure & Compute

Montauk Capital

New York (NY)

On-site

USD 120,000 - 160,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Equity options
Studio support from Montauk Capital

Job summary

Montauk Capital seeks an experienced Infrastructure Engineer in New York to lead GPU infrastructure and manage hardware selections. This role focuses on the design, implementation, and operational maintenance of a metro edge compute platform. You will work on GPU provisioning, automate monitoring, and scale deployments in real-world environments, thereby addressing the AI inference bottleneck and contributing to transformative tech at the edge.

Qualifications

  • Strong infrastructure engineer experienced with hardware deployment.
  • Experience managing compute infrastructure in real-world environments.
  • Ownership of GPU provisioning and hardware selection.

Responsibilities

  • Own GPU infrastructure design and implementation.
  • Manage deployments at production scale.
  • Build automation and monitoring stack for distributed edge nodes.

Skills

Infrastructure engineering
GPU provisioning
Deployment planning
Linux systems
Networking fundamentals
Operational troubleshooting

Education

Experience in data center environments

Tools

RHEL/Ubuntu
IPMI/Redfish
BMC-based remote management

Job description

Montauk Capital seeks an experienced Infrastructure Engineer in New York to lead GPU infrastructure and manage hardware selections. This role focuses on the design, implementation, and operational maintenance of a metro edge compute platform. You will work on GPU provisioning, automate monitoring, and scale deployments in real-world environments, thereby addressing the AI inference bottleneck and contributing to transformative tech at the edge.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Head of Edge AI Inference
Head of Edge AI Inference

Montauk Capital • New York (NY)

On-site
USD 150,000 - 200,000
Competitive compensation + equity
Studio support from Montauk Capital’s network
Infrastructure Engineer, Perimeter Compute
Infrastructure Engineer, Perimeter Compute

Montauk Capital • New York (NY)

On-site
USD 120,000 - 160,000
Competitive compensation
Equity options
Studio support from Montauk Capital
Head of Edge Data Center Operations
Head of Edge Data Center Operations

Montauk Capital • New York (NY)

On-site
USD 150,000 - 230,000
Senior GPU Systems Engineer: Scale AI Clusters & HPC
Senior GPU Systems Engineer: Scale AI Clusters & HPC

Career Techniques • New York (NY)

Hybrid
USD 200,000 - 300,000
AI Infrastructure Engineer: Scale GPU ML Pipelines
AI Infrastructure Engineer: Scale GPU ML Pipelines

Akkodis • Town of Florida (NY)

On-site
USD 125,000 - 130,000
Senior InfraOps Engineer — GPU Infra, Hybrid, Equity
Senior InfraOps Engineer — GPU Infra, Hybrid, Equity

Lightning AI • New York (NY)

Hybrid
USD 160,000 - 200,000
Health coverage
Equity/RSUs
401(k) matching
+1
Senior Manager GPU Cloud Networking & Infrastructure Equity
Senior Manager GPU Cloud Networking & Infrastructure Equity

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 256,000 - 414,000
Senior GPU ML Inference Engineer — Edge AI Platforms
Senior GPU ML Inference Engineer — Edge AI Platforms

NVIDIA • Westford (MA)

On-site
USD 224,000 - 432,000
Senior Engineer, GPU Fleet Automation & Ops
Senior Engineer, GPU Fleet Automation & Ops

NVIDIA • New York (NY)

On-site
USD 308,000 - 472,000
Head of Compute Economics & GPU Infrastructure
Head of Compute Economics & GPU Infrastructure

Cognichip • Redwood City (CA)

On-site
USD 180,000 - 300,000
Early-stage equity
Competitive compensation package
Collaborative culture