Senior HPC Hardware Engineer

NorthMark Compute & Cloud; Dallas (TX); On-site; USD 150,000 - 200,000; Full time

Job summary

NorthMark Compute & Cloud is seeking a Senior HPC Hardware Engineer to join the Compute Engineering team in Dallas, TX. This hands-on role owns the full hardware lifecycle for a large HPC/AI compute fleet, spanning GPU and CPU nodes built on cutting-edge NVIDIA platforms.

You will drive hardware standards, automation, and production readiness, collaborating closely with software, networking, and vendor teams.

Qualifications

• Bachelor’s degree or equivalent hands-on experience in electrical or computer engineering.
• 5+ years of experience managing large-scale HPC/AI compute infrastructure in production.
• Deep knowledge of server hardware architecture, including processors, memory, storage, networking, power, and thermal management.
• Hands-on in bare-metal provisioning, firmware/BIOS lifecycle management, and hardware automation tools.
• Proficiency with Redfish API and BMC/IPMI tooling (iDRAC, iLO) for remote hardware management.
• Ability to troubleshoot complex hardware issues across GPU/CPU nodes, including NVIDIA-SMI.
• Experience with hardware monitoring, performance tuning, and capacity planning at scale.
• Familiarity with Linux and scripting (Python/Bash/PowerShell) for automation.
• Experience with OpenStack Ironic or similar cloud/bare-metal provisioning.
• Strong cross-functional communication and leadership experience.

Responsibilities

• Design, configure, and manage a high-performance compute fleet (GPU/CPU nodes).
• Own firmware and BIOS lifecycle across the HPC/AI fleet, including baselines and rollout.
• Lead hardware troubleshooting across components (CPUs, GPUs, DPUs, NVSwitches, NICs, memory).
• Automate health checks, onboarding, and remediation to accelerate deployment.
• Validate next‑gen AI platforms (NVL72/Grace) for production readiness.
• Collaborate with vendors to diagnose firmware/hardware issues; provide reproduction cases and logs.
• Perform hardware performance analysis, tuning, and capacity planning for scale-out.
• Define security hardening practices for hardware infrastructure.
• Leverage IaC and scripting for repeatable infrastructure management.
• Mentor engineers and drive best-practice improvements.

Skills

Technical leadership

Troubleshooting

Automation mindset

Cross-functional collaboration

Mentoring

Education

Bachelor’s degree in Electrical/Computer Engineering

Tools

Ansible

Puppet

Chef

Redfish API

IPMI/iDRAC/iLO

OpenStack Ironic

Lua/Python scripting

NVIDIA SMI

Job description

The Company

NorthMark Compute & Cloud (NMC²) is backed by dedicated leadership and investment, with a clear mission as it operates at the bleeding edge of technology. Its goal is to scale and enhance the high-performance computing (HPC) and cloud infrastructure that supports its clients’ research, production, and delivery, enabling breakthroughs that shape the industries of tomorrow. Its engineers build critical infrastructure to eliminate friction in scientific research, simulations, analysis, and decision‑making, accelerating discovery and driving faster innovation.

The Company

NorthMark Compute & Cloud (NMC²) is backed by dedicated leadership and investment, with a clear mission as it operates at the bleeding edge of technology. Its goal is to scale and enhance the high-performance computing (HPC) and cloud infrastructure that supports its clients’ research, production, and delivery, enabling breakthroughs that shape the industries of tomorrow. Its engineers build critical infrastructure to eliminate friction in scientific research, simulations, analysis, and decision‑making, accelerating discovery and driving faster innovation.

THE POSITION

NMC² is seeking a Senior HPC Hardware Engineer to join the Compute Engineering team based at our Dallas, TX offices at Victory Commons. This is a hands‑on role at the center of one of the most demanding and rapidly scaling HPC environments in operation, spanning a large fleet of GPU and CPU nodes built on the latest NVIDIA platforms including H200 and GB200/NVL72 architectures. You will own the full hardware lifecycle for NMC²’s compute fleet — from bare‑metal provisioning and firmware baseline management through production validation, troubleshooting, and capacity planning. You will be the go‑to expert on server hardware architecture, driving standards and automation that ensure the fleet operates at peak performance and availability. Your work directly enables the research and delivery workloads that NMC²’s clients depend on. This role requires close collaboration with Software Engineering, Networking, and Vendor teams, and involves mentoring junior engineers. The ideal candidate is a technically deep infrastructure leader who thrives in fast‑paced environments, brings a strong automation mindset, and has a proven track record managing large‑scale HPC or AI compute infrastructure.

Responsibilities

• Design, configure, and manage a high-performance compute fleet comprising large-scale GPU (NVIDIA V100/A100/H200/GB200) and CPU nodes across NMC²’s Dallas infrastructure.
• Own the full firmware and BIOS lifecycle across the HPC/AI fleet — from establishing baselines and validation through rollout, compliance, and ongoing maintenance.
• Lead troubleshooting of hardware components including CPUs, GPUs, DPUs, NVSwitches, NICs, memory, PSUs, and BMCs; drive component replacement and configuration remediation.
• Automate health checks, onboarding workflows, and recurring hardware issue remediation to accelerate safe deployment and reduce recovery time.
• Validate and operationalize next‑generation AI platforms (e.g., NVL72 / Grace Blackwell) from day one, ensuring stability, performance readiness, and production fitness.
• Collaborate with vendors on firmware and hardware issues, providing clear reproduction cases, diagnostic logs, and business impact to drive timely resolution.
• Perform hardware performance analysis, tuning, and capacity planning to ensure reliable scale‑out of the compute environment.
• Define and implement security hardening best practices for hardware infrastructure, maintaining platform integrity across the fleet.
• Leverage Infrastructure as Code (IaC) methodologies and scripting to drive efficient, repeatable, and scalable infrastructure management.
• Mentor junior engineers, act as a subject matter expert for infrastructure‑related escalations, and champion a culture of continuous improvement across the team.

Requirements

• Bachelor’s degree in Electrical Engineering, Computer Engineering, or a related field, or equivalent hands‑on experience.
• 5+ years of experience managing large‑scale HPC or AI compute infrastructure in a production environment.
• Deep knowledge of server hardware architecture, including processors, memory, storage, networking, power systems, and thermal management.
• Hands‑on experience with bare‑metal provisioning, firmware and BIOS lifecycle management, and hardware automation tools such as Ansible, Puppet, or Chef.
• Proficiency with Redfish API and BMC/IPMI tooling (iDRAC, iLO) for remote hardware management and diagnostics.
• Demonstrated ability to troubleshoot and resolve complex hardware issues across GPU and CPU nodes, including NVIDIA‑SMI and GPU diagnostics.
• Experience with hardware monitoring platforms, performance tuning, and capacity planning at scale.
• Familiarity with Linux‑based environments and scripting proficiency in Python, Bash, or PowerShell for infrastructure automation.
• Experience with OpenStack (particularly Ironic) or equivalent cloud/bare‑metal provisioning platforms is strongly preferred.
• Strong cross‑functional communication skills and proven ability to collaborate effectively with software, networking, and vendor teams.
• Prior technical leadership experience, including mentoring engineers and driving team‑wide best practices.