Senior AI Middleware Engineer — Remote HPC Systems

Cornelis Networks, Inc.; United States; Remote; USD 120,000 - 190,000; Full time

Benefits offered by this job

Equity

Cash incentives

Health benefits

401(k) with company match

Open Time Off

Paid holidays

Job summary

Cornelis Networks, Inc. is seeking a Senior Software Engineer to design, develop, and upstream-enable AI communication middleware for scalable AI/HPC workloads.

You will work on distributed AI tasks, optimize collective communications, and collaborate across kernel, driver, switch, and systems teams. This remote role within the United States offers a compensation package with equity and incentives, plus comprehensive health and retirement benefits.

Qualifications

• 8+ years of experience in high-performance systems programming in C/C++ on Linux.
• Strong experience with GPU communication stacks including CUDA/ROCm and NCCL/RCCL.
• Ability to optimize distributed training performance using profiling and tracing.
• Understanding of collective communication concepts and topology awareness.
• Experience delivering production-quality code.
• Open-source contributions in relevant areas.

Responsibilities

• Design and implement performance-critical features for CCL enablement on Cornelis Networks' fabrics.
• Optimize distributed training performance across multi-node, multi-GPU configurations.
• Improve GPU communication paths including GPU-direct transfers, IPC, and CPU/GPU synchronization.
• Profile distributed AI workloads and identify bottlenecks across the software and hardware stack.
• Prototype and validate Ultra Ethernet capabilities for AI collective communication.
• Collaborate with kernel/driver, switch, performance, and systems teams.

Skills

C/C++

Linux

GPU communication

Profiling & tracing

Open-source

Distributed systems

Tools

CUDA

ROCm

NCCL/RCCL

libfabric/OFI

UCX

RDMA

Job description

Cornelis Networks, Inc. is seeking a Senior Software Engineer to design, develop, and upstream-enable AI communication middleware for scalable AI/HPC workloads.

You will work on distributed AI tasks, optimize collective communications, and collaborate across kernel, driver, switch, and systems teams. This remote role within the United States offers a compensation package with equity and incentives, plus comprehensive health and retirement benefits.