Senior LLM Systems Engineer: Scale Inference

Evollabs Tech; Dubai; On-site; AED 420,000 - 660,000; Full time

Job summary

Evollabs Tech in Dubai is seeking an experienced engineer to advance LLM inference performance across distributed, multi-chip platforms. You will optimize transformer-based models and collaborate with hardware teams to push efficiency in AI inference at datacenter scale.

The role focuses on state-of-the-art LLM internals, quantization, KV caching, and parallelism strategies, with hands-on work on LLaMA, Mistral, Qwen, and related technologies.

Qualifications

• Strong understanding of transformer architectures and LLM internals.
• Hands-on experience with multiple modern LLMs (e.g., LLaMA, Mistral, Qwen).
• Experience with LLM inference optimization techniques (quantization, KV caching, batching).

Responsibilities

• Analyze, profile and optimize LLM inference performance across distributed, multi-chip systems.
• Evaluate and benchmark different LLMs on custom hardware.
• Design and implement optimizations for attention mechanisms and model-level performance.

Skills

Transformer architectures

LLM internals

Performance optimization

PyTorch/JAX

Distributed systems

Python

Benchmarking

Tools

PyTorch

JAX

CUDA

Job description

Evollabs Tech in Dubai is seeking an experienced engineer to advance LLM inference performance across distributed, multi-chip platforms. You will optimize transformer-based models and collaborate with hardware teams to push efficiency in AI inference at datacenter scale.

The role focuses on state-of-the-art LLM internals, quantization, KV caching, and parallelism strategies, with hands-on work on LLaMA, Mistral, Qwen, and related technologies.