Senior GPU Systems Engineer for AI Clusters & Linux

RPMGlobal; Bethesda, Northern (MD, KY); Hybrid; USD 180,000 - 240,000; Full time

Job summary

RPMGlobal seeks an experienced engineer to support enterprise AI mission systems by designing, developing, and optimizing GPU clusters with a focus on OS, hardware, GPU platforms, and high-speed networking in a secure environment.

You will design and maintain GPU clusters, optimize drivers, collaborate with AI/ML engineers, and ensure compliance with DoD security standards while leveraging Linux-based environments and modern orchestration tools.

Qualifications

• Active TS/SCI clearance is required with ability to obtain CI Polygraph.
• Bachelor's degree with at least 10 years in the category field.
• Experience managing NVIDIA GPU data center platforms (DGX, HGX, H200, H100, L4s).
• Strong knowledge of enterprise server components and Linux distributions (RHEL, Ubuntu, Oracle, Rocky).
• DoD 8570.11 IAT Level II certification required; Level III acceptable.
• U.S. citizenship is required for government contracts.

Responsibilities

• Design, configure, and maintain GPU clusters.
• Collaborate with a multidisciplinary team to optimize architectures for performance and power efficiency.
• Work with AI/ML engineers to integrate GPUs with Linux-based systems.
• Optimize GPU drivers for compatibility, reliability, and performance.
• Analyze GPU performance, identify bottlenecks, and improve efficiency across hardware and software layers.
• Build and maintain debugging tools, profiling utilities, and performance analysis software for Linux.
• Leverage Bash, Python, Ansible, Puppet, and Salt for tooling and automation.
• Maintain technical documentation, architectural specs, and Linux best practices.
• Support ATO activities and ensure compliance with federal security standards.

Skills

Security clearance TS/SCI

CI Polygraph

Linux expert

NVIDIA DGX/HGX experience

DoD IAT II

US citizenship

Team collaboration

Education

Bachelor's degree with 10 years experience

Master's degree with 10 years experience

PhD with 10 years experience

Tools

Kubernetes

Argo

Airflow

Kubeflow

Prometheus

Grafana

Slurm

LSF

Job description

RPMGlobal seeks an experienced engineer to support enterprise AI mission systems by designing, developing, and optimizing GPU clusters with a focus on OS, hardware, GPU platforms, and high-speed networking in a secure environment.

You will design and maintain GPU clusters, optimize drivers, collaborate with AI/ML engineers, and ensure compliance with DoD security standards while leveraging Linux-based environments and modern orchestration tools.