Senior LLMOps / AI Platform Engineer

Hire Rightt; Dubai; On-site; AED 279,000 - 335,000; Full time

Job summary

Hire Rightt in Dubai seeks an experienced Senior LLMOps / AI Platform Engineer to design, deploy, and optimize production-grade AI infrastructure for financial services. You will manage LLM inference, GPUs, Kubernetes, and cloud services.

You will implement observability, RAG systems, embeddings, and vector databases while building robust CI/CD pipelines in a fast-paced environment.

Qualifications

• Strong Python and FastAPI experience.
• vLLM, Hugging Face and self-hosted LLM deployment.
• Kubernetes, Docker, Helm and AWS.
• NVIDIA GPU inference and performance optimization.
• LangChain / LangGraph/LangSmith.
• RAG, embeddings and vector databases (Qdrant).
• LLM observability and monitoring.
• PostgreSQL / Redis.
• GitHub Actions / CI/CD.
• Strong production troubleshooting skills.

Responsibilities

• Deploy and operate self-hosted LLMs using vLLM, SGLang, Ollama.
• Optimize LLM inference for latency, throughput, concurrency, GPU memory, KV cache, and cost.
• Manage GPU workloads across multiple NVIDIA GPUs.
• Deploy and maintain AI services on Kubernetes / AWS EKS using Docker and Helm.
• Implement LLM reliability mechanisms including health checks, monitoring, automated recovery, and model restart/refresh strategies.
• Implement observability using Langfuse/LangSmith, OpenTelemetry, Prometheus, and Grafana.
• Deploy and optimize RAG systems, embedding models, and vector databases such as Qdrant, Milvus.
• Support AI agents and workflows built with LangChain and LangGraph.
• Build and maintain CI/CD pipelines for AI services and infrastructure.
• Troubleshoot production issues across LLMs, GPUs, Kubernetes, networking, and AI applications.

Skills

Python

FastAPI

LLM deployment

Kubernetes

Docker

AWS

LangChain / LangGraph / LangSmith

RAG

Embeddings

Qdrant

Milvus

PostgreSQL / Redis

GitHub Actions / CI/CD

Production troubleshooting

Tools

Kubernetes

Docker

Helm

AWS

LangChain

LangGraph

LangSmith

Qdrant

Milvus

PostgreSQL

Redis

Job description

Position: Senior LLMOps / AI Platform Engineer

Location: Dubai

Industry: Financial Services

Salary: AED 25 - 30K/ month

Role Overview:

The job holder will be responsible for building, deploying, optimizing, and operating production-grade LLM and Generative AI infrastructure. The role combines LLM inference, GPU optimization, Kubernetes, cloud infrastructure, observability, RAG, and AI platform engineering.

Responsibilities:

• Deploy and operate self-hosted LLMs using vLLM, SGLang, Ollama.
• Optimize LLM inference for latency, throughput, concurrency, GPU memory, KV cache, and cost.
• Manage GPU workloads across multiple NVIDIA GPUs.
• Deploy and maintain AI services on Kubernetes / AWS EKS using Docker and Helm.
• Implement LLM reliability mechanisms including health checks, monitoring, automated recovery, and model restart/refresh strategies.
• Implement observability using Langfuse/LangSmith, OpenTelemetry, Prometheus, and Grafana.
• Deploy and optimize RAG systems, embedding models, and vector databases such as Qdrant, Milvus.
• Support AI agents and workflows built with LangChain and LangGraph.
• Build and maintain CI/CD pipelines for AI services and infrastructure.
• Troubleshoot production issues across LLMs, GPUs, Kubernetes, networking, and AI applications.

Requirements:

• Strong Python and FastAPI experience
• vLLM, Hugging Face and self-hosted LLM deployment
• Kubernetes, Docker, Helm and AWS
• NVIDIA GPU inference and performance optimization
• LangChain / LangGraph/LangSmith
• RAG, embeddings and vector databases (Qdrant)
• LLM observability and monitoring
• PostgreSQL / Redis
• GitHub Actions / CI/CD
• Strong production troubleshooting skills