Senior ML Systems Engineer: Production GPU & LLM Infra

Remotedxb; Dubai; On-site; AED 350,000 - 600,000; Full time

Benefits offered by this job

Comprehensive Health Insurance

Paid Leave (Vacation/PTO)

Paid Holidays

Sick Leave

Parental Leave

Bereavement Leave

401(k) Employer Match

Employee Referral Bonuses

Job summary

Egen is a fast-growing company focused on data-driven AI solutions. We are seeking a senior ML/AI engineer to optimize production LLM serving, profile large training runs, and deploy models on scalable GPU clusters.

You will work with vLLM/SGLang and Kubernetes to deliver high-performance AI architectures for client projects. Ideal candidates have 5+ years in ML/AI engineering, strong Python and shell scripting skills, and hands-on experience with GPU optimization and cloud deployment.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related technical field.
• 5+ years of experience in ML/AI engineering focused on performance, infrastructure, or systems.
• Proven track record of deploying and optimizing models in production environments.
• Experience profiling and improving GPU utilization for training and/or inference.
• Mastery of Python and shell scripting.
• Hands-on experience with vLLM, SGLang, or comparable high-performance serving stacks.
• Strong Kubernetes (GKE) experience for deploying models on Google Cloud.
• Knowledge of Data Engineering and SQL.

Responsibilities

• Optimize inference by building and tuning production LLM serving with vLLM and SGLang.
• Profile and accelerate training runs to resolve bottlenecks using FlashAttention.
• Engineer for hardware by applying understanding of GPU architecture and attention internals.
• Deploy and operate multiple models within shared GPU clusters on GKE with autoscaling.
• Drive efficiency by owning GPU utilization and improving throughput-per-dollar.
• Collaborate and consult with clients to translate business needs into high-performance AI architectures.

Skills

Python

Shell scripting

GPU utilization profiling

High-performance AI serving

Client collaboration

Education

Bachelor's or Master's in CS/Engineering

Tools

vLLM

SGLang

Kubernetes (GKE)

Google Cloud

SQL

Job description

Egen is a fast-growing company focused on data-driven AI solutions. We are seeking a senior ML/AI engineer to optimize production LLM serving, profile large training runs, and deploy models on scalable GPU clusters.

You will work with vLLM/SGLang and Kubernetes to deliver high-performance AI architectures for client projects. Ideal candidates have 5+ years in ML/AI engineering, strong Python and shell scripting skills, and hands-on experience with GPU optimization and cloud deployment.