Dubai-based Senior AI Engineer—LLM Inference & Performance

HireHouse; Dubai; On-site; AED 400,000 - 800,000; Full time

Job summary

Gateworth Group partners with a technology organisation in the UAE to scale its AI engineering function, focusing on high‑performance model optimisation and advanced AI infrastructure. The role involves deep work on transformer models, inference tuning, and deployment strategies across large-scale environments.

You will contribute to analysis, tuning, benchmarking and architectural decisions, working across hardware, systems and software to push the limits of production AI systems.

Qualifications

• Strong understanding of transformer architectures, LLM internals and both dense/MoE models.
• Hands-on experience with modern LLMs and attention-level optimisation.
• Background in distributed systems and large-scale inference workloads.

Responsibilities

• Improve and optimise LLM inference performance across distributed environments.
• Benchmark LLMs across varied hardware stacks.
• Design attention-level optimisation (Flash Attention, grouped-query, sliding-window).
• Deliver model-level optimisation including quantisation, KV-cache strategies, batching and parallelism.
• Collaborate with hardware, systems and compiler teams on inference pipelines.
• Build and maintain benchmarking frameworks to measure latency and throughput.

Skills

Transformer architectures

LLM internals

Dense & MoE models

Python (PyTorch/JAX)

Profiling performance

Distributed systems

Job description

Gateworth Group partners with a technology organisation in the UAE to scale its AI engineering function, focusing on high‑performance model optimisation and advanced AI infrastructure. The role involves deep work on transformer models, inference tuning, and deployment strategies across large-scale environments.

You will contribute to analysis, tuning, benchmarking and architectural decisions, working across hardware, systems and software to push the limits of production AI systems.