Senior Model Performance Engineer – Frontier AI Inference

YTL AI Labs; Kuala Lumpur; On-site; MYR 180,000 - 300,000; Full time

Job summary

YTL AI Labs, a Malaysian sovereign AI company, seeks a Model Performance Engineer to design and optimize large-scale inference systems for LLMs, multimodal, and speech models. You will drive latency, throughput, and cost efficiency while productionizing cutting-edge research.

You will work across GPU clusters, memory management, and serving frameworks to ensure robust, real-world deployment at scale.

Qualifications

• 3–5+ years in ML systems, backend or HPC.
• Strong experience with large-scale inference systems in production.
• Hands-on GPU optimization and memory management.
• Familiar with serving frameworks (vLLM, TensorRT-LLM, Triton).

Responsibilities

• Lead design and implementation of high-performance inference systems for LLMs and multimodal models.
• Optimize throughput, latency, and memory usage across GPU clusters.
• Collaborate with research to productionize new models and architectures.
• Build benchmarking pipelines and diagnose bottlenecks in distributed systems.

Skills

Deep learning frameworks

Python

C++

GPU architectures

Distributed systems

Tools

CUDA

TensorRT

Triton

vLLM

Job description

YTL AI Labs, a Malaysian sovereign AI company, seeks a Model Performance Engineer to design and optimize large-scale inference systems for LLMs, multimodal, and speech models. You will drive latency, throughput, and cost efficiency while productionizing cutting-edge research.

You will work across GPU clusters, memory management, and serving frameworks to ensure robust, real-world deployment at scale.