Senior AI Middleware Engineer — Remote + Equity

Cornelis Networks; Austin (TX); On-site; USD 150,000 - 230,000; Full time

Benefits offered by this job

medical, dental, and vision coverage

disability and life insurance

a dependent care flexible spending账户

accidental injury insurance

pet insurance

generous paid holidays

401(k) with company match

Open Time Off (OTO) for regular full‑‑

sick time

bonding leave

pregnancy disability leave

Job summary

Cornelis Networks is seeking a highly experienced Senior Software Engineer to design, develop, and upstream-enable our AI communication middleware. This role focuses on distributed AI workloads and optimizing collective communication libraries (NCCL/RCCL) over our interconnects.

You will work across kernel/driver, switch, performance, and systems teams to deliver production-quality code, benchmarks, and upstream contributions, with remote-friendly arrangements for the United States.

Qualifications

• 8+ years of experience in high-performance systems programming in C/C++ on Linux.
• Strong experience with GPU communication stacks including CUDA/ROCm and NCCL/RCCL.
• Ability to optimize distributed training performance using profiling and tracing.
• Understanding of collective communication concepts and topology awareness.
• Experience delivering production-quality code.
• Open-source contributions in relevant areas.

Responsibilities

• Design and implement performance-critical features for CCL enablement on Cornelis Networks' fabrics.
• Optimize distributed training performance across multi-node, multi-GPU configurations.
• Improve GPU communication paths including GPU-direct transfers, IPC, and CPU/GPU synchronization.
• Profile distributed AI workloads and identify bottlenecks across the software and hardware stack.
• Tune AI frameworks such as PyTorch Distributed, TensorFlow/XLA, JAX, DeepSpeed, and Megatron-LM.
• Develop benchmarks and microbenchmarks aligned with real model performance.
• Contribute upstream to AI communication and distributed training projects.
• Participate in design reviews, code reviews, CI, and long-term maintenance.
• Prototype and validate Ultra Ethernet capabilities for AI collective communication.
• Provide technical input for deployment considerations and performance validation.
• Collaborate with kernel/driver, switch, performance, and systems teams.
• Support advanced escalations by analyzing traces and providing robust fixes.

Skills

C/C++

Linux

GPU communication stacks

Profiling & tracing

NCCL/RCCL

Open-source contributions

Tools

libfabric/OFI

UCX

RDMA concepts

RoCEv2

Ultra Ethernet

Job description

Cornelis Networks is seeking a highly experienced Senior Software Engineer to design, develop, and upstream-enable our AI communication middleware. This role focuses on distributed AI workloads and optimizing collective communication libraries (NCCL/RCCL) over our interconnects.

You will work across kernel/driver, switch, performance, and systems teams to deliver production-quality code, benchmarks, and upstream contributions, with remote-friendly arrangements for the United States.