Senior Network CCL Engineer for AI Accelerators

Gateworth Group; Dubai; On-site; AED 350,000 - 700,000; Full time

Benefits offered by this job

Competitive salary

Bonus

Benefits

Job summary

Gateworth Group is seeking a Network CCL Engineer to work on collective communication for large-scale AI infrastructure in Dubai. You will design heterogeneous communication paths across accelerator and GPU devices and build runtime components for device discovery, topology awareness, and synchronization.

Collaborate with hardware, runtime, compiler and distributed systems teams to optimize bandwidth, latency, and overhead.

Qualifications

• 5+ years in distributed systems, runtime engineering, networking or accelerator-level development.
• Strong C/C++ and Python programming experience.
• Solid understanding of collective communication operations (AllReduce, ReduceScatter, AllGather, AllToAll, Broadcast, Send/Recv, Barrier).
• Familiarity with NCCL, RCCL, oneCCL, MPI, UCX or libfabric.
• A good understanding of GPU/NPU memory behaviour, memory registration, peer-to-peer transfers and heterogeneous device communication.
• Experience with runtime concepts including queues, streams, events, command submission, synchronization and memory management.
• Understanding of hardware-software interaction: DMA engines, device memory, interrupts, doorbells, fences and completion signalling.
• Knowledge of high-performance networking technologies (InfiniBand, RoCE).
• Experience with distributed training frameworks or custom communication backends is a bonus.
• Exposure to communication optimisation for LLM workloads (tensor parallelism, MoE, KV-cache movement) would be advantageous.
• Experience integrating communication layers with modern distributed inference frameworks would be helpful.

Responsibilities

• Design heterogeneous communication paths across accelerator and GPU devices.
• Create the runtime components for device discovery, rank management, topology awareness, queues, streams, events and synchronization.
• Collaborate with hardware, runtime, compiler and distributed systems teams on scalable communication solutions.
• Diagnose and optimise communication bottlenecks including bandwidth, latency, congestion and synchronization overhead.

Skills

Distributed systems

C/C++

Python

Collective communications

NCCL/MPI/UCX

GPU memory

Performance tuning

Tools

NCCL

MPI

UCX

libfabric

Job description

Gateworth Group is seeking a Network CCL Engineer to work on collective communication for large-scale AI infrastructure in Dubai. You will design heterogeneous communication paths across accelerator and GPU devices and build runtime components for device discovery, topology awareness, and synchronization.

Collaborate with hardware, runtime, compiler and distributed systems teams to optimize bandwidth, latency, and overhead.