Lead Machine Learning Engineer, Inference & Performance

Remotedxb; Dubai; On-site; AED 350,000 - 600,000; Full time

Benefits offered by this job

Comprehensive Health Insurance

Paid Leave (Vacation/PTO)

Paid Holidays

Sick Leave

Parental Leave

Bereavement Leave

401(k) Employer Match

Employee Referral Bonuses

Job summary

Egen is a fast-growing company focused on data-driven AI solutions. We are seeking a senior ML/AI engineer to optimize production LLM serving, profile large training runs, and deploy models on scalable GPU clusters.

You will work with vLLM/SGLang and Kubernetes to deliver high-performance AI architectures for client projects. Ideal candidates have 5+ years in ML/AI engineering, strong Python and shell scripting skills, and hands-on experience with GPU optimization and cloud deployment.

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related technical field.
• 5+ years of experience in ML/AI engineering focused on performance, infrastructure, or systems.
• Proven track record of deploying and optimizing models in production environments.
• Experience profiling and improving GPU utilization for training and/or inference.
• Mastery of Python and shell scripting.
• Hands-on experience with vLLM, SGLang, or comparable high-performance serving stacks.
• Strong Kubernetes (GKE) experience for deploying models on Google Cloud.
• Knowledge of Data Engineering and SQL.

Responsibilities

• Optimize inference by building and tuning production LLM serving with vLLM and SGLang.
• Profile and accelerate training runs to resolve bottlenecks using FlashAttention.
• Engineer for hardware by applying understanding of GPU architecture and attention internals.
• Deploy and operate multiple models within shared GPU clusters on GKE with autoscaling.
• Drive efficiency by owning GPU utilization and improving throughput-per-dollar.
• Collaborate and consult with clients to translate business needs into high-performance AI architectures.

Skills

Python

Shell scripting

GPU utilization profiling

High-performance AI serving

Client collaboration

Education

Bachelor's or Master's in CS/Engineering

Tools

vLLM

SGLang

Kubernetes (GKE)

Google Cloud

SQL

Job description

About the Company

Egen is a fast-growing and entrepreneurial company with a data-first mindset. We bring together the best engineering talent working with the most advanced technology platforms, including Google Cloud and Salesforce, to help clients drive action and impact through data and insights.

Responsibilities

• Optimize inference by building and tuning production LLM serving with vLLM and SGLang
• Profile and accelerate training runs to resolve bottlenecks using FlashAttention
• Engineer for hardware by applying understanding of GPU architecture and attention internals
• Deploy and operate multiple models within shared GPU clusters on GKE with autoscaling
• Drive efficiency by owning GPU utilization and improving throughput-per-dollar
• Collaborate and consult with clients to translate business needs into high-performance AI architectures

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related technical field
• 5+ years of experience in ML/AI engineering focused on performance, infrastructure, or systems
• Proven track record of deploying and optimizing models in production environments
• Experience profiling and improving GPU utilization for training and/or inference
• Mastery of Python and shell scripting
• Hands-on experience with vLLM, SGLang, or comparable high-performance serving stacks
• Strong Kubernetes (GKE) experience for deploying models on Google Cloud
• Knowledge of Data Engineering and SQL

Preferred Qualifications

• Experience with Classic Machine Learning (neural nets, training, tuning)
• Ability to reason about lower-level (CUDA-adjacent) performance code

Benefits

• Comprehensive Health Insurance
• Paid Leave (Vacation/PTO)
• Paid Holidays
• Sick Leave
• Parental Leave
• Bereavement Leave
• 401(k) Employer Match
• Employee Referral Bonuses