GPU Systems Engineer 3

RPMGlobal

Bethesda (MD)

On-site

USD 120,000 - 260,000

Full time

7 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

RPMGlobal is seeking a senior, security-cleared engineer to design, deploy, and optimize GPU clusters for enterprise AI mission systems. You will work with Linux-based environments, collaborate with AI/ML teams, and drive performance improvements across hardware and software layers.

Responsibilities include integration with NVIDIA data center platforms, driver optimization, tooling automation, documentation, and ensuring compliance with federal security standards.

Qualifications

  • Active TS/SCI clearance with ability to obtain CI Polygraph.
  • Bachelor's degree with six years experience or 9 years without a degree.
  • Experience managing NVIDIA GPU data center platforms (DGX, HGX, H200, H100, L4s).
  • Strong Linux expertise (RHEL, Ubuntu, Oracle, Rocky).
  • IAT Level II/III certification requirements.
  • U.S. citizenship required for government contracts.

Responsibilities

  • Design, configure, and maintain GPU clusters.
  • Collaborate to optimize architectures for performance and efficiency.
  • Work with AI/ML engineers to integrate GPUs with Linux systems.
  • Optimize GPU drivers for reliability and performance.
  • Analyze GPU performance and remove bottlenecks across hardware/software.
  • Build and maintain debugging tools and performance analysis software for Linux.
  • Use Bash, Python, Ansible, Puppet, Salt for tooling/automation.
  • Document architectures and Linux best practices.
  • Support ATO activities and ensure DoD security compliance.

Skills

Linux administration
Python scripting
Bash scripting
Ansible
Puppet
Salt
Kubernetes
Prometheus
Grafana
Slurm
LSF

Education

Bachelor's Degree
High School Diploma / GED
Associates Degree
Master's Degree
PhD

Tools

NVIDIA DGX
HGX
H200
H100
L4s
DoD 8570.11 IAT certifications

Job description

Position Summary

Support enterprise AI mission systems by designing, developing, and optimizing GPU clusters, with deep focus on operating systems, hardware, GPU platforms, and high-speed networking in a secure customer environment.

Essential Duties and Responsibilities
  • Design, configure, and maintain GPU clusters.
  • Collaborate with a multidisciplinary team to define and optimize architectures for performance, power efficiency, and required features.
  • Work closely with AI/ML engineers to integrate GPUs with Linux-based systems.
  • Optimize GPU drivers for compatibility, reliability, and performance.
  • Analyze GPU performance, identify bottlenecks, and develop strategies to improve efficiency across hardware and software layers.
  • Build and maintain debugging tools, profiling utilities, and performance analysis software for Linux environments.
  • Leverage Bash, Python, Ansible, Puppet, and Salt for tooling and automation.
  • Maintain technical documentation, architectural specifications, and Linux best practices.
  • Support ATO activities and ensure compliance with federal security standards.
Required Qualifications
  • Active TS/SCI with ability to obtain a CI Polygraph.
  • Bachelor's degree with a minimum of six years of experience in the category field. Three additional years of experience may be substituted for the bachelor's degree.
  • Experience managing NVIDIA GPU data center platforms, including DGX, HGX, H200, H100, and L4s.
  • Knowledge of enterprise server components, including storage/network controllers, HBAs, and SSDs.
  • Strong expertise with Linux distributions, including RHEL, Ubuntu, Oracle, and Rocky.
  • Excellent problem-solving skills and the ability to collaborate within a team.
  • Meet DoD 8570.11 IAT Level II certification requirements at a minimum; IAT Level III is also acceptable.
  • U.S. citizenship is required due to the nature of the government contracts supported.
Preferred Qualifications
  • Experience with Kubernetes cluster management and AI/ML workflow orchestration, including Argo, Airflow, and Kubeflow.
  • Familiarity with GPU virtualization and cloud computing.
  • Experience with Prometheus and Grafana for monitoring.
  • Knowledge of distributed resource scheduling systems such as Slurm, LSF, or similar tools.
Required Education and Experience Equivalency
  • High School Diploma/GED with 9 years of experience.
  • Associates Degree with 9 years of experience.
  • Bachelors' Degree with 6 years of experience.
  • Masters' Degree with 6 years of experience.
  • PhD with 6 years of experience.
RequiredCertifications
  • DoD 8570.11 IAT Level II certification: Security+ CE, CCNA-Security, GICSP, GSEC, or SSCP.
Required Security Clearance
  • Active TS/SCI with ability to obtain a CI Polygraph.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

GPU Systems Engineer 4
GPU Systems Engineer 4

RPMGlobal • Bethesda (MD)

On-site
USD 140,000 - 190,000
GPU Systems Engineer 3
GPU Systems Engineer 3

Base-2 Solutions • Bethesda (MD)

On-site
USD 130,000 - 170,000
Medical premiums covered
Dental premiums covered
Vision premiums covered
+2
GPU Systems Engineer 4
GPU Systems Engineer 4

Base-2 Solutions • Bethesda (MD)

On-site
USD 160,000 - 220,000
401(k) with company match
Company-paid health premiums
PTO & holidays
Graphics Processing Unit (GPU) Engineer - TS/SCI
Graphics Processing Unit (GPU) Engineer - TS/SCI

Sunayu • Bethesda (MD)

On-site
USD 120,000 - 150,000
3 Medical Plan Options
Dental and Vision
401k plan with up to a 6% match
+1
Systems Engineer - HPC & GPU Infrastructure
Systems Engineer - HPC & GPU Infrastructure

Leidos Inc • Bethesda (MD)

On-site
USD 70,000 - 90,000
Senior GPU Systems Architect for AI Clusters
Senior GPU Systems Architect for AI Clusters

RPMGlobal • Bethesda (MD)

On-site
USD 140,000 - 190,000
Cluster Engineer
Cluster Engineer

STN Inc • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior System Engineer – GPU Platforms
Senior System Engineer – GPU Platforms

Jobtailor • San Jose (CA)

On-site
USD 150,000 - 210,000
AI Operations & Infrastructure Engineer
AI Operations & Infrastructure Engineer

Invictus International Consulting, LLC • Fort Meade (MD)

On-site
USD 100,000 - 130,000
GPU Systems Engineer III — AI Clusters & Linux
GPU Systems Engineer III — AI Clusters & Linux

RPMGlobal • Bethesda (MD)

On-site
USD 120,000 - 260,000