AI Infrastructure Engineer, Fleet & Automation

Nscale; Northern (KY); Hybrid; USD 150,000 - 215,000; Full time

Benefits offered by this job

Base + equity

Equity

Growth opportunities

Job summary

Nscale is hiring an Infrastructure Software Engineer for Fleet & Automation to drive the control plane, tooling, and automation that powers our AI infrastructure and HPC environments. You will implement scalable workflows, provision devices, and collaborate across teams to improve reliability and efficiency.

The role emphasizes Python production systems, observability, and integration with GPU hardware programs. Nscale offers growth, equity, and a fast-paced startup culture.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or a related field or equivalent practical experience.
• 5+ years of experience building large-scale infrastructure applications or similar.
• Proficiency in C, C++, Java, and Python for API design and testing.
• Strong Linux, networking (TCP/IP, BGP), and configuration management basics (Ansible, Terraform).
• Experience with distributed systems, hardware lifecycle management, and AI/HPC infrastructure.

Responsibilities

• Perform technical architecture, roadmap and implementation for workflow automation systems, balancing automation complexity with reliability.
• Own end-to-end delivery of device provisioning, validation, testing, and remediation workflows at scale.
• Design and build workflow orchestration systems for hardware lifecycle management (GPU nodes, switches).
• Collaborate with Infrastructure, Platform and SRE teams to translate operational needs into scalable automation.
• Establish engineering standards for reliability, observability and best practices.
• Build production-grade Python systems for hardware automation and AI-assisted improvements.
• Work with cross-functional teams to create interoperable automated systems.

Education

Bachelor's degree in Computer Science, Computer Engineering, or related field

Master’s degree or PhD in Engineering, Computer Science, or related field

Tools

C

C++

Java

Python

Linux

TCP/IP

BGP

Ansible

Terraform

NVIDIA GPUs

InfiniBand

OpenStack

MAAS

Ironic

IPMI

Kubernetes

Docker

Prometheus

Grafana

OpenTelemetry

NCCL

SLURM

Job description

Nscale is hiring an Infrastructure Software Engineer for Fleet & Automation to drive the control plane, tooling, and automation that powers our AI infrastructure and HPC environments. You will implement scalable workflows, provision devices, and collaborate across teams to improve reliability and efficiency.

The role emphasizes Python production systems, observability, and integration with GPU hardware programs. Nscale offers growth, equity, and a fast-paced startup culture.