AI Infrastructure & Automation Engineer

Nscale

New York (NY)

On-site

USD 140,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive package
Equity
Growth opportunities

Job summary

Nscale seeks an Infrastructure Software Engineer for Fleet & Automation to strengthen the AI infrastructure operations and scale our GPU HPC environments. You will own the control plane, tooling, and automation that support fleet, network operations, and observability, driving availability and cost efficiency.

You'll build production-grade Python systems for hardware lifecycle automation, work with AI tools, and collaborate with product, design, and operations teams to deliver robust,

Qualifications

  • Bachelor's degree in CS/CE or equivalent experience.
  • 5+ years building large-scale infrastructure applications.
  • Proficiency in C, C++, Java; Python for API design and testing.
  • Strong Linux, networking (TCP/IP, BGP) and configuration management tools.
  • Experience with distributed systems and hardware lifecycle tooling.

Responsibilities

  • Architect and deliver automated workflows for device provisioning and validation.
  • Design workflow orchestration for GPU nodes and network hardware.
  • Collaborate with infra, platform and SRE teams to meet reliability goals.
  • Build production-grade Python systems for hardware lifecycle automation.
  • Establish engineering standards for observability and reliability.
  • Evaluate AI tooling impact on the software stack.
  • Partner with cross-functional teams to ensure maintainable automation.

Skills

C
C++
Java
Python

Education

Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience

Tools

Ansible
Terraform
NetBox
OpenStack
MAAS
Ironic

Job description

Nscale seeks an Infrastructure Software Engineer for Fleet & Automation to strengthen the AI infrastructure operations and scale our GPU HPC environments. You will own the control plane, tooling, and automation that support fleet, network operations, and observability, driving availability and cost efficiency.

You'll build production-grade Python systems for hardware lifecycle automation, work with AI tools, and collaborate with product, design, and operations teams to deliver robust,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Infra Software Engineer: Fleet & HPC Automation
Infra Software Engineer: Fleet & HPC Automation

Nscale • Seattle (WA)

On-site
USD 150,000 - 215,000
Highly competitive package with equity
Flexible workplace
Medical, dental, vision benefits
+2
Principal AI Infrastructure Engineer — GPU Fleet
Principal AI Infrastructure Engineer — GPU Fleet

Nscale • Bellevue (WA)

On-site
USD 240,000 - 400,000
Medical, dental, vision
Flexible paid time off
Parental leave
+1
Infrastructure Software Engineer, Fleet & Automation New Houston; New York; San Francisco; Seattle
Infrastructure Software Engineer, Fleet & Automation New Houston; New York; San Francisco; Seattle

Nscale • New York (NY)

On-site
USD 140,000 - 210,000
Competitive package
Equity
Growth opportunities
Staff Software Engineer: Fleet Management & Automation
Staff Software Engineer: Fleet Management & Automation

NScale Global Holdings Limited • United States

Hybrid
USD 220,000 - 320,000
Medical insurance
Dental insurance
Vision insurance
+3
Lead Principal Engineer: AI-Driven GPU Fleet Automation
Lead Principal Engineer: AI-Driven GPU Fleet Automation

Nscale • Seattle (WA)

On-site
USD 240,000 - 400,000
Medical, dental, vision
Flexible PTO
Parental leave
+1
GPU HPC Infrastructure Engineer | Scale & Automation
GPU HPC Infrastructure Engineer | Scale & Automation

OpenAI • New York (NY)

On-site
USD 150,000 - 210,000
AI Infrastructure Architect | Kubernetes & GPU Ops
AI Infrastructure Architect | Kubernetes & GPU Ops

Sapsf • United States

On-site
USD 140,000 - 170,000
AI Infrastructure Engineer — Automate GPU Fleets (Hybrid)
AI Infrastructure Engineer — Automate GPU Fleets (Hybrid)

WeHireYou • New Amsterdam (IN)

Hybrid
USD 113,000 - 181,000
AI Infrastructure Network Operations Engineer
AI Infrastructure Network Operations Engineer

OpenAI • San Francisco (CA)

On-site
USD 140,000 - 210,000
Fleet Hardware Reliability Engineer (Automation & Scale)
Fleet Hardware Reliability Engineer (Automation & Scale)

Rozgoo • San Francisco (CA)

On-site
USD 190,000 - 240,000