Senior GPU Systems Engineer – Large-Scale AI & HPC

Iceberg; New York (NY); On-site; USD 200,000 - 300,000; Full time

Job summary

Iceberg is seeking a GPU Systems Engineer in New York to design and scale GPU infrastructure across thousands of nodes and petabytes of storage. You will profile workloads, identify bottlenecks, and build automation to keep a massive fleet running with minimal human intervention.

You'll work across Linux, GPU infra, GPUDirect RDMA, CUDA, C/C++, Python, networking and distributed systems, with exposure to hardware selection and architecture from design to production.

Qualifications

• 5+ years of experience with large-scale Linux systems in HPC/AI or distributed infrastructure environments.
• Hands-on experience with GPU infrastructure design and performance profiling.
• Strong fundamentals in CUDA, C/C++, and Python.

Responsibilities

• Design and scale GPU clusters and storage infrastructure.
• Profile workloads and optimize performance across the stack.
• Develop automation to minimize manual intervention and outages.
• Collaborate across hardware, software, and networking teams.

Skills

Linux systems

GPU infrastructure

CUDA

C/C++

Python

Profiling & optimization

Distributed systems

Networking

Performance tuning

Automation

Tools

GPUDirect RDMA

NVIDIA CUDA

NCCL

NVLink

Profiling tools

Job description

Iceberg is seeking a GPU Systems Engineer in New York to design and scale GPU infrastructure across thousands of nodes and petabytes of storage. You will profile workloads, identify bottlenecks, and build automation to keep a massive fleet running with minimal human intervention.

You'll work across Linux, GPU infra, GPUDirect RDMA, CUDA, C/C++, Python, networking and distributed systems, with exposure to hardware selection and architecture from design to production.