Infrastructure Engineer, Perimeter Compute

Montauk Capital

New York (NY)

On-site

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Equity options
Studio support from Montauk Capital

Job summary

Montauk Capital seeks an experienced Infrastructure Engineer in New York to lead GPU infrastructure and manage hardware selections. This role focuses on the design, implementation, and operational maintenance of a metro edge compute platform. You will work on GPU provisioning, automate monitoring, and scale deployments in real-world environments, thereby addressing the AI inference bottleneck and contributing to transformative tech at the edge.

Qualifications

  • Strong infrastructure engineer experienced with hardware deployment.
  • Experience managing compute infrastructure in real-world environments.
  • Ownership of GPU provisioning and hardware selection.

Responsibilities

  • Own GPU infrastructure design and implementation.
  • Manage deployments at production scale.
  • Build automation and monitoring stack for distributed edge nodes.

Skills

Infrastructure engineering
GPU provisioning
Deployment planning
Linux systems
Networking fundamentals
Operational troubleshooting

Education

Experience in data center environments

Tools

RHEL/Ubuntu
IPMI/Redfish
BMC-based remote management

Job description

About Montauk Capital Montauk Capital builds and backs companies at the forefront of the Electron Economy, the generational shift towards electrified, intelligent technologies reshaping industries and driving unprecedented demand for energy. Our team combines deep investing acumen with decades of operating experience to give founders the strategic clarity and hands‑on support that accelerates the building of enduring companies of consequence.

About Stealth Edge AI Co Co‑founded by Montauk Capital, Stealth Edge AI Co is a pre‑seed venture specialized in modular, metro‑edge AI capabilities. By leveraging existing infrastructure for inference deployment, Edge AI provides low‑latency, SLA‑guaranteed performance across diverse GPU SKUs and colocation environments. Our technology intelligently routes traffic based on demand proximity and real‑world network limitations, bypassing the heavy power and infrastructure requirements of traditional hyperscalers. Currently initiating operations with pilot nodes in NYC, we are executing a city‑by‑city expansion strategy with plans for a broader multi‑metro rollout.

About The Role We’re building the automation, orchestration, and monitoring layer that unifies disparate metro edge GPU nodes into a single software‑managed compute platform. You’ll own the definition, design, implementation, and execution of the hardware and infrastructure build‑out, executing strategy across edge data center requirements, GPU selection, supply chain, technical implementation, operational maintenance and deployment as we scale. You’ll take the foundational groundwork and execute across the entire hardware and infrastructure side of our company, transforming our roadmap into production‑scale compute for AI inferencing. You’ll ensure the GPU clusters deliver on customer requirements, are highly‑available, and will be the hands‑on expert for the hardware side of our business. Most importantly, you’ll turn our high‑level plans into real, technical execution, and will play a key role in making supply‑chain decisions about infrastructure and how we deploy, scale, and support it.

What You’ll Do
  • Own GPU infrastructure design and implementation details from planning through deployment
  • Own hardware selection, configuration, and deployment across early compute infrastructure
  • Help turn early technical groundwork into a functioning deployed system
  • Own the GPU roadmap we use to entice customers and build partnerships
  • Deploy, operate, and tune GPU clusters for both bare‑metal and internal software stack
  • Own resilient networking implementation from each site to the cluster, including a robust OOB network for constant monitoring and management
  • Manage deployments at production scale
  • Interface with site ops on power, cooling, and connectivity
  • Build the automation and monitoring stack for distributed edge nodes
  • Own the supply chain for all infrastructure gear
  • Manage third‑party hardware vendors on provisioning, maintenance and break‑fix support
What You’ll Bring

You’re a strong infrastructure engineer experienced with hardware deployment, data center environments, GPU selection, systems setup and design. You can manage the implementation details end to end and have ownership over the entire process. If AI infrastructure is your jam and you’ve built systems in production, we want to talk.

  • Strong infrastructure engineering experience and systems‑level technical judgment
  • Experience deploying or managing compute infrastructure in real‑world environments
  • Experience with data center, hardware, or GPU‑based systems implementation
  • Experience owning GPU provisioning, hardware selection, and systems configuration
  • GPU scheduling and orchestration specifics: GPU type awareness, memory management, topology considerations, placement strategies for multi‑GPU jobs, and fragmentation minimization
  • Bare‑metal provisioning lifecycle: IPMI/Redfish, BMC‑based remote management, PXE boot, and automated OS deployment workflows
  • On‑board storage
  • Observability stack: distributed configuration and troubleshooting, plus monitoring, alerting, and tracing
  • Deployment planning, Hardware configuration, Operational troubleshooting
  • Linux systems depth: RHEL/Ubuntu, low‑level troubleshooting, shell scripting
  • Security and operational best practices for bare metal
  • Deployment tooling at production scale
  • Networking fundamentals for inference workloads and OOB management
  • Startup / 0→1 DNA: You ship fast and communicate clearly.
Why Join Us
  • Category‑Defining Opportunity: Solving the AI inference bottleneck without the burden of power and infrastructure constraints
  • Massive Market Opportunity: AI spending projected to exceed hundreds of billions annually, 54GW of AI Inference demand expected by 2030
  • Studio Support: Leverage Montauk Capital’s resources, network, and operational expertise during critical early stages
  • Competitive compensation + equity: True ownership over what you build
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Head of Inference, Perimeter Compute
Head of Inference, Perimeter Compute

Montauk Capital • New York (NY)

On-site
USD 150,000 - 200,000
Competitive compensation + equity
Studio support from Montauk Capital’s network
Director of Site Operations, Edge AI Stealth Co
Director of Site Operations, Edge AI Stealth Co

Montauk Capital • New York (NY)

On-site
USD 120,000 - 160,000
Competitive compensation + equity
Access to Montauk Capital's resources
Head of Real Estate, Perimeter Compute
Head of Real Estate, Perimeter Compute

Montauk Capital • New York (NY)

On-site
USD 150,000 - 250,000
Competitive compensation + equity
Access to Montauk Capital's resources and network
Infrastructure Deployment Manager, Perimeter Compute
Infrastructure Deployment Manager, Perimeter Compute

Montauk Capital, L.L.C. • New York (NY)

On-site
USD 150,000 - 190,000
Equity
Competitive pay
Senior Infrastructure Engineer
Senior Infrastructure Engineer

DeepInfra • Palo Alto (CA)

On-site
USD 180,000 - 320,000
Head of Infrastructure
Head of Infrastructure

General Compute • San Francisco (CA)

On-site
USD 190,000 - 280,000
Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Prime Intellect • United States

On-site
USD 120,000 - 150,000
Member of Technical Staff - GPU Infrastructure
Member of Technical Staff - GPU Infrastructure

Prime Intellect, Inc. • San Francisco (CA)

On-site
USD 150,000 - 300,000
Equity incentives
Principal Hardware Design Engineer
Principal Hardware Design Engineer

Designworks Talent LLC • Bellevue (WA)

Hybrid
USD 180,000 - 230,000
Medical, dental, and vision insurance
401(k) plan with company match
Paid holidays
Senior GPU Infrastructure Architect for Frontier AI
Senior GPU Infrastructure Architect for Frontier AI

Prime Intellect, Inc. • San Francisco (CA)

Hybrid
USD 150,000 - 300,000
Equity incentives