Senior Server Administrator

Harvey Nash; Chicago (IL); Hybrid; USD 96,432 - 103,320; Full time

Job summary

A national talent management firm is hiring a Senior Server Administrator for their AI Engineering team. You will manage and optimize high-performance GPU computing infrastructure, collaborating with AI researchers and engineers. Ideal candidates will have significant experience in server administration and NVIDIA GPU technologies, as well as strong Linux skills. The role offers a hybrid work model with competitive pay ranging from $70 to $75 per hour.

Qualifications

• 8+ years of experience in server administration.
• 5+ years with NVIDIA GPU-based systems.
• Strong skills in Linux administration.

Responsibilities

• Administer and maintain GPU-accelerated servers.
• Manage NVIDIA software stack and monitor system performance.
• Implement security best practices.

Skills

Linux administration

NVIDIA GPU systems

HPC or AI environments

Performance tuning

Monitoring tools

Automation tools

Education

Bachelor's Degree

Tools

NVIDIA software stack

Docker

Kubernetes

Ansible

Terraform

Prometheus

Grafana

Job description

We’re hiring a Senior Server Administrator to join our client’s AI Engineering team. This role is pivotal in deploying, maintaining, and optimizing high-performance computing infrastructure leveraging NVIDIA GPU technologies. You will collaborate with AI researchers, data scientists, and software engineers to ensure systems are robust, scalable, and tuned for cutting‑edge machine learning workloads.

Base pay range

$70.00/yr - $75.00/yr

Job Title: Senior Server Administrator

Location: Chicago/ Peoria, Cary, Phoenix

Contract: 12 Months

Work Environment: Hybrid: 1 day/week onsite, transitioning to 5 days/week onsite when notified.

Hourly Rate: $70-75 (W2)

Key Responsibilities:

• Administer and maintain GPU‑accelerated servers and clusters (NVIDIA A100, H100, etc.).
• Manage and optimize NVIDIA software stack (CUDA, cuDNN, TensorRT, NCCL, NGC containers).
• Monitor system performance, troubleshoot issues, and ensure high availability.
• Support containerized workflows (Docker, Kubernetes) and distributed training environments.
• Implement security best practices and compliance standards.
• Lead upgrades, patching, and lifecycle management of GPU servers.
• Provide documentation, automation scripts, and training for internal teams.

What We’re Looking For:

• Bachelor’s Degree with 8+ years of experience, including 5+ years in server administration and 3+ years with NVIDIA GPU‑based systems.
• Strong Linux administration skills in HPC or AI environments.
• Hands‑on experience with NVIDIA GPU drivers, CUDA toolkit, and performance tuning.
• Familiarity with Slurm, Kubernetes, and orchestration tools.
• Experience with monitoring tools (Prometheus, Grafana) and automation (Ansible, Terraform).

Strong expertise in:

• NVIDIA Certified Professional or similar credentials.
• Experience with multi‑GPU/multi‑node training setups.
• Familiarity with AI/ML frameworks (PyTorch, TensorFlow).
• Exposure to cloud‑based GPU infrastructure (AWS, Azure, GCP).

About us:

Harvey Nash is a national, full‑service talent management firm specializing in technology positions. Our company was founded with a mission to serve as the talent partner of choice for the information technology industry.

Our company vision has led us to incredible growth and success in a relatively short period of time and continues to guide us today. We are committed to operating with the highest possible standards of honesty, integrity, and a passionate commitment to our clients, consultants, and employees.

We are part of Nash Squared Group, a global professional services organization with over forty offices worldwide.

Please visit us at https://www.harveynashusa.com/

Harvey Nash will provide benefits please review: 2025 Benefits -- Corporate