Infra Software Engineer, Fleet & Automation for AI/HPC

Nscale; New York (NY); On-site; USD 150,000 - 215,000; Full time

Benefits offered by this job

Equity

Medical insurance

Dental insurance

Vision insurance

Flexible PTO

Parental leave

Retirement plan

Job summary

Nscale is seeking an Infrastructure Software Engineer for Fleet & Automation in New York. You will help build and maintain the control plane, tooling, and automation for AI infrastructure and HPC environments, driving higher availability and lower costs.

You’ll own end-to-end workflows for provisioning and validating hardware, while collaborating with cross-functional teams to implement scalable automation and reliable software systems.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or equivalent practical experience.
• 5+ years of experience building large-scale infrastructure applications or similar.
• Proficiency in C, C++, Java, Python for API design and testing.
• Strong Linux OS, networking (TCP/IP, BGP) fundamentals, and config tooling (Ansible, Terraform).
• Experience with distributed systems, stateful/stateless services, and infra tooling (DCIMs, NetBox, OpenStack, MAAS, Ironic, IPMI).
• Familiarity with AI/HPC infra (NVIDIA GPUs, InfiniBand) and observability tools.

Responsibilities

• Architect, roadmap and implement workflow automation systems balancing automation complexity, reliability, and maintainability.
• Own end-to-end device provisioning, validation, testing, and remediation workflows at scale.
• Design and build workflow orchestration for hardware lifecycle management (GPU nodes, switches).
• Collaborate with Infra, Platform, SRE to translate ops needs into scalable automation.
• Set engineering standards for reliability, observability and best practices across services.
• Build production-grade Python systems for hardware lifecycle automation; explore AI-driven improvements.
• Collaborate with product, design, ops and infra teams to create interoperable automated systems.

Skills

C

C++

Java

Python

Linux

Networking

APIs

Education

Bachelor's degree in Computer Science/Engineering or equivalent

Tools

Ansible

Terraform

DCIMs

NetBox

OpenStack

MAAS

Ironic

IPMI

NCCL

Prometheus

Grafana

OpenTelemetry

Kubernetes

Docker

Job description

Nscale is seeking an Infrastructure Software Engineer for Fleet & Automation in New York. You will help build and maintain the control plane, tooling, and automation for AI infrastructure and HPC environments, driving higher availability and lower costs.

You’ll own end-to-end workflows for provisioning and validating hardware, while collaborating with cross-functional teams to implement scalable automation and reliable software systems.