Lead GPU Systems Engineer - HPC & AI Infrastructure

Socket.dev; New York (NY); Hybrid; USD 200,000 - 300,000; Full time

Benefits offered by this job

Hybrid working opportunities

Generous PTO

Wellness programs

Free meals

Learning & development

Job summary

Tower Research Capital seeks an accomplished engineer to design, deploy, and scale distributed GPU clusters, building out hardware selection, production operations, and monitoring across thousands of nodes.

You will diagnose bottlenecks across compute, storage, and network layers, collaborating with researchers to benchmark workloads and translate results into speedups. Strong Linux, CUDA/C++, and Python skills are essential.

Qualifications

• 5+ years engineering large-scale Linux systems in HPC or distributed-infrastructure environments.
• Deep Linux fundamentals: installation, performance tuning, and kernel-level debugging.
• Hands-on troubleshooting of distributed GPU workloads with a strong GPU performance model.
• Experience with GPUDirect RDMA and understanding data movement between GPUs and the network.
• Proficiency in Python for automation; CUDA or C/C++ experience.
• Familiarity with configuration management tools such as Salt, Ansible, Puppet, or Chef.
• Clear communication with researchers, engineers, and vendors.

Responsibilities

• Design, deploy, and scale distributed GPU clusters, from hardware selection and network topology through to production operation.
• Track down performance bottlenecks across the full stack: compute, storage, network, and the seams between them.
• Partner with researchers to profile and benchmark GPU workloads, then turn the findings into measurable speedups.
• Build the automation that lets a small team operate thousands of nodes: provisioning, monitoring, diagnostics, and self-healing.
• Own infrastructure projects end to end, from scope and design through implementation and long-term support.
• Qualify new generations of hardware and software, and work directly with vendors to root-cause complex issues.

Skills

Linux systems

GPU computing

Python

CUDA/C++

RDMA

GPU troubleshooting

Communication

Tools

Salt

Ansible

Puppet

Chef

Job description

Tower Research Capital seeks an accomplished engineer to design, deploy, and scale distributed GPU clusters, building out hardware selection, production operations, and monitoring across thousands of nodes.

You will diagnose bottlenecks across compute, storage, and network layers, collaborating with researchers to benchmark workloads and translate results into speedups. Strong Linux, CUDA/C++, and Python skills are essential.