Senior LLM Inference Platform Engineer

Jobgether; Dubai; On-site; AED 500,000 - 800,000; Full time

Benefits offered by this job

Equity

Health insurance

Remote-first culture

Ownership of architecture roadmap

Job summary

Jobgether is seeking a Senior Inference Engineer based in the United Arab Emirates to build and own an inference platform from the ground up. You will work with the CTO to turn large language models into production-grade, scalable systems across GPU environments.

You will deploy model-serving infrastructure using vLLM, SGLang, and TensorRT-LLM, focusing on latency, throughput, and cost. This remote-first startup values ownership, speed, and measurable customer impact.

Qualifications

• Significant professional experience building and operating production software or infrastructure systems.

Responsibilities

• Build and deploy production-grade LLM inference systems across GPU machines, owning the complete pipeline from customer query to served response.
• Design, implement, and operate model-serving infrastructure using technologies such as vLLM, SGLang, and TensorRT-LLM.
• Optimize inference workloads for scale, balancing latency, throughput, reliability, and infrastructure costs.
• Apply techniques such as quantization, batching, caching, and intelligent request routing to improve inference performance.
• Develop robust production infrastructure using Python or Golang, with an emphasis on maintainable, scalable engineering rather than configuration-only work.
• Establish the initial inference platform in close collaboration with the CTO and take ownership of its evolution as the organization scales.
• Define and execute the technical roadmap for inference infrastructure, identifying opportunities to improve performance, reliability, and developer or customer experience.
• Partner with Product to translate evolving customer and market requirements into practical inference-platform capabilities.
• Evaluate emerging inference technologies and approaches and determine where they can create meaningful improvements.
• Collaborate with engineering stakeholders to establish reliable operational practices for production GPU infrastructure.

Skills

Python

Golang

vLLM

SGLang

TensorRT-LLM

PyTorch

Transformers

CUDA

NCCL

Tools

Docker

Kubernetes

Job description

Jobgether is seeking a Senior Inference Engineer based in the United Arab Emirates to build and own an inference platform from the ground up. You will work with the CTO to turn large language models into production-grade, scalable systems across GPU environments.

You will deploy model-serving infrastructure using vLLM, SGLang, and TensorRT-LLM, focusing on latency, throughput, and cost. This remote-first startup values ownership, speed, and measurable customer impact.