Senior AI Middleware Engineer — Remote & HPC

Cornelis Networks, Inc.; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Equity

Cash incentives

Health benefits

401(k) match

Paid time off

Job summary

Cornelis Networks, Inc. is seeking a highly experienced Senior Software Engineer to design, develop, and upstream-enable its AI communication middleware.

Focus areas include distributed AI workloads and optimizing collective communication libraries over Cornelis interconnects. The role requires deep expertise in C/C++, Linux, and GPU communication stacks, with responsibilities spanning kernel/driver collaboration, performance profiling, and upstream contributions to open-source projects.

Qualifications

• 8+ years of experience in high-performance systems programming in C/C++ on Linux.
• Strong experience with GPU communication stacks including CUDA/ROCm and NCCL/RCCL.
• Ability to optimize distributed training performance using profiling and tracing.
• Understanding of collective communication concepts and topology awareness.
• Experience delivering production-quality code.
• Open-source contributions in relevant areas.

Responsibilities

• Design and implement performance-critical features for CCL enablement on Cornelis Networks’ fabrics.
• Optimize distributed training performance across multi-node, multi-GPU configurations.
• Improve GPU communication paths including GPU-direct transfers, IPC, and CPU/GPU synchronization.
• Profile distributed AI workloads and identify bottlenecks across the software and hardware stack.
• Tune AI frameworks such as PyTorch Distributed, TensorFlow/XLA, JAX, DeepSpeed, and Megatron-LM.
• Develop benchmarks and microbenchmarks aligned with real model performance.
• Contribute upstream to AI communication and distributed training projects.
• Collaborate with kernel/driver, switch, performance, and systems teams.

Skills

HPC systems programming

C/C++ on Linux

GPU communication stacks

Profiling & tracing

NCCL/RCCL

Distributed training

Tools

libfabric/OFI

UCX

RDMA concepts

RoCEv2

Ultra Ethernet

Job description

Cornelis Networks, Inc. is seeking a highly experienced Senior Software Engineer to design, develop, and upstream-enable its AI communication middleware.

Focus areas include distributed AI workloads and optimizing collective communication libraries over Cornelis interconnects. The role requires deep expertise in C/C++, Linux, and GPU communication stacks, with responsibilities spanning kernel/driver collaboration, performance profiling, and upstream contributions to open-source projects.