GPU Systems Engineer 4

RPMGlobal

Bethesda, Northern (MD, KY)

Hybrid

USD 180,000 - 240,000

Full time

3 days ago
Be an early applicant
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

RPMGlobal seeks a senior engineer to design, deploy, and optimize GPU clusters for enterprise AI in a secure government environment in Bethesda, MD. You will work with AI/ML engineers to integrate GPUs with Linux, tune drivers, and ensure compliance with DoD security standards.

Responsibilities include building automation tooling and maintaining architectural docs while collaborating with cross‑functional teams on performance improvements.

Qualifications

  • Active TS/SCI with the ability to obtain a CI Polygraph.
  • Bachelor's degree with substantial experience in the field.
  • Experience managing NVIDIA GPU data center platforms (DGX/HGX/H200/H100/L4s).
  • Strong Linux knowledge (RHEL/Ubuntu/Oracle/Rocky).
  • Knowledge of DoD 8570.11 IAT security requirements.

Responsibilities

  • Design, configure, and maintain GPU clusters.
  • Collaborate with a multidisciplinary team to optimize architectures for performance and security.
  • Integrate GPUs with Linux-based systems for AI workflows.
  • Tune GPU drivers for reliability and performance.
  • Analyze performance and implement optimization strategies.
  • Develop tooling with Bash, Python, Ansible, and Salt.
  • Maintain architecture docs and Linux best practices.
  • Support DoD security compliance activities.

Skills

Linux
GPU clusters
Performance tuning
Scripting Bash/Python
CI/CD collaboration
DoD security standards

Education

Bachelor's degree
Master's degree
PhD

Tools

Kubernetes
Argo
Airflow
Kubeflow
Prometheus
Grafana
Slurm
LSF
GPU virtualization
Cloud computing

Job description

Position Summary

Support enterprise AI mission systems by designing, developing, and optimizing GPU clusters, with deep focus on operating systems, hardware, GPU platforms, and high-speed networking in a secure customer environment.

Essential Duties and Responsibilities
  • Design, configure, and maintain GPU clusters.
  • Collaborate with a multidisciplinary team to define and optimize architectures for performance, power efficiency, and required features.
  • Work closely with AI/ML engineers to integrate GPUs with Linux-based systems.
  • Optimize GPU drivers for compatibility, reliability, and performance.
  • Analyze GPU performance, identify bottlenecks, and develop strategies to improve efficiency across hardware and software layers.
  • Build and maintain debugging tools, profiling utilities, and performance analysis software for Linux environments.
  • Leverage Bash, Python, Ansible, Puppet, and Salt for tooling and automation.
  • Maintain technical documentation, architectural specifications, and Linux best practices.
  • Support ATO activities and ensure compliance with federal security standards.
Required Qualifications
  • Active TS/SCI with ability to obtain a CI Polygraph.
  • Bachelor's degree with a minimum of ten years of experience in the category field.
  • Experience managing NVIDIA GPU data center platforms, including DGX, HGX, H200, H100, and L4s.
  • Knowledge of enterprise server components, including storage/network controllers, HBAs, and SSDs.
  • Strong expertise with Linux distributions, including RHEL, Ubuntu, Oracle, and Rocky.
  • Excellent problem-solving skills and the ability to collaborate within a team.
  • Meet DoD 8570.11 IAT Level II certification requirements at a minimum; IAT Level III is also acceptable.
  • U.S. citizenship is required due to the nature of the government contracts supported.
Preferred Qualifications
  • Experience with Kubernetes cluster management and AI/ML workflow orchestration, including Argo, Airflow, and Kubeflow.
  • Familiarity with GPU virtualization and cloud computing.
  • Experience with Prometheus and Grafana for monitoring.
  • Knowledge of distributed resource scheduling systems such as Slurm, LSF, or similar tools.
Required Education and Experience Equivalency
  • Bachelors' Degree with 10 years of experience.
  • Masters' Degree with 10 years of experience.
  • PhD with 10 years of experience.
RequiredCertifications
  • DoD 8570.11 IAT Level II certification: Security+ CE, CCNA-Security, GICSP, GSEC, or SSCP.
Required Security Clearance
  • Active TS/SCI with ability to obtain a CI Polygraph.
Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

GPU Systems Engineer 4
GPU Systems Engineer 4

Base-2 Solutions • Bethesda (MD)

On-site
USD 180,000 - 230,000
GPU Systems Engineer 4 with Security Clearance
GPU Systems Engineer 4 with Security Clearance

Base-2 Solutions • Chevy Chase (MD)

On-site
USD 170,000 - 210,000
Health insurance
Dental insurance
Vision insurance
+2
Systems Engineer – HPC & GPU Infrastructure
Systems Engineer – HPC & GPU Infrastructure

MAXISIQ, Inc. • Bethesda (MD)

On-site
USD 170,000 - 210,000
Systems Engineer – HPC & GPU Infrastructure
Systems Engineer – HPC & GPU Infrastructure

FiveInsights • Bethesda (MD)

On-site
USD 170,000 - 210,000
Graphics Processing Unit (GPU) Engineer - TS/SCI
Graphics Processing Unit (GPU) Engineer - TS/SCI

Sunayu • Bethesda (MD)

On-site
USD 120,000 - 150,000
3 Medical Plan Options
Dental and Vision
401k plan with up to a 6% match
+1
GPU Systems Infrastructure Engineer
GPU Systems Infrastructure Engineer

Blue Signal Search • Fremont (CA)

On-site
USD 120,000 - 170,000
GPU Systems Engineer
GPU Systems Engineer

Career Techniques • New York (NY)

Hybrid
USD 200,000 - 300,000
Cluster Engineer
Cluster Engineer

STN Inc • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Systems and Platform Engineer
Senior Systems and Platform Engineer

MAXISIQ, Inc. • Bethesda (MD)

On-site
USD 170,000 - 210,000
AI Operations & Infrastructure Engineer
AI Operations & Infrastructure Engineer

Invictus International Consulting, LLC • Fort Meade (MD)

On-site
USD 100,000 - 130,000