Remote Senior AI Middleware Engineer for High-Perf Training

Cornelis Networks, Inc.; Austin (TX); Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401(k) with company match

Generous paid holidays

Job summary

A high-performance networking solutions company is seeking a Senior Software Engineer to enhance AI communication middleware. This position focuses on optimizing distributed AI workloads and collective communication libraries over advanced interconnects. Candidates should have over 8 years in high-performance programming, particularly with CUDA/ROCm and NCCL/RCCL. This is a remote role for U.S. residents, offering a competitive salary package including equity and comprehensive benefits.

Qualifications

• 8+ years of experience in high-performance systems programming in C/C++ on Linux.
• Strong experience with GPU communication stacks including CUDA/ROCm and NCCL/RCCL.
• Experience delivering production-quality code.

Responsibilities

• Design and implement performance-critical features for CCL enablement on fabrics.
• Optimize distributed training performance across multi-node, multi-GPU configurations.
• Improve GPU communication paths including GPU-direct transfers, IPC, and CPU/GPU synchronization.

Skills

High-performance systems programming

CUDA/ROCm

NCCL/RCCL

Profiling and tracing

Collective communication concepts

Tools

PyTorch Distributed

DeepSpeed

Megatron-LM

Job description

A high-performance networking solutions company is seeking a Senior Software Engineer to enhance AI communication middleware. This position focuses on optimizing distributed AI workloads and collective communication libraries over advanced interconnects. Candidates should have over 8 years in high-performance programming, particularly with CUDA/ROCm and NCCL/RCCL. This is a remote role for U.S. residents, offering a competitive salary package including equity and comprehensive benefits.