Senior Runtime Engineer - C/C++ for AI Hardware

Evollabs Tech; Dubai; On-site; AED 400,000 - 650,000; Full time

Job summary

Evollabs Tech is seeking an experienced Senior Runtime Software Engineer to own the core runtime architecture that bridges compiler frameworks and AI hardware. You will drive runtime performance and stability, and shape memory management, scheduling, and observability—collaborating with firmware and driver teams.

You will work on concurrency models for model execution, profiling, and low-latency optimizations to ensure scalable, maintainable solutions for real-world AI workloads on our NPUs.

Qualifications

• 5–8+ years in systems software, runtime or performance-critical infra.
• Proficiency in C/C++ and Python.
• Strong knowledge of OS fundamentals, multithreading, synchronization and memory management.
• Experience near hardware (GPU/accelerator/driver/firmware).
• Familiarity with command queues, execution engines and DMA-based systems.
• Understanding of computational graphs, tensor execution and memory layouts.
• Experience profiling/optimizing latency and throughput in performance-sensitive systems.

Responsibilities

• Own core runtime architecture bridging compiler and hardware.
• Improve runtime execution engine performance and stability.
• Design device memory management and efficiency improvements.
• Collaborate on command submission and hardware interaction layer.

Skills

C/C++

Python

Operating systems

Multi-threading

Memory management

Profiling/Optimization

GPU/driver/firmware familiarity

Tools

CUDA

MLIR

LLVM

ONNX Runtime

TensorRT

Job description

Evollabs Tech is seeking an experienced Senior Runtime Software Engineer to own the core runtime architecture that bridges compiler frameworks and AI hardware. You will drive runtime performance and stability, and shape memory management, scheduling, and observability—collaborating with firmware and driver teams.

You will work on concurrency models for model execution, profiling, and low-latency optimizations to ensure scalable, maintainable solutions for real-world AI workloads on our NPUs.