MLOps Engineer

TALENTMATE; Abu Dhabi; On-site; AED 360,000 - 600,000; Full time

Job summary

AI71 in Abu Dhabi is seeking an Executive-Level MLOps Engineer to own ML infrastructure strategy, spanning SaaS and on-prem, including LLM deployment, fine-tuning and serving at scale.

You will mentor engineers, define deployment pipelines (MLflow, Kubeflow), monitor reliability, and drive cross-team initiatives to improve performance and cost efficiency.

Qualifications include 10+ years in MLOps, deep cloud expertise, Python, and experience with on-prem air-gapped environments.

Qualifications

• 10+ years in MLOps or ML infrastructure with architectural ownership.
• Proven track record deploying large-scale models (LLMs) at scale.
• Deep cloud expertise across AWS, Azure, or GCP and Python proficiency.
• Mentorship of engineers to operate independently at higher levels.
• Experience with SaaS and on-prem / air-gapped deployments.
• Kubernetes at architectural depth including GPU scheduling and multi-tenancy.
• Strong communication and stakeholder management for diverse teams.

Responsibilities

• Define ML infra architecture across deployment, pipelines, and cloud infra.
• Set reliability targets: monitoring, latency, availability, incident response.
• Mentor senior MLOps engineers across teams.
• Drive cross-team initiatives to improve inference performance and cost-efficiency.
• Partner with ML researchers and product leadership on multi-quarter infra strategy.
• Ensure infra scales across SaaS and air-gapped on-prem deployments.

Skills

MLOps

ML infrastructure

Python

Kubernetes

Distributed training

Cloud platforms

Stakeholder management

Mentorship

Tools

Kubeflow

MLflow

Kubeflow

Slurm

Triton

DeepSpeed

FSDP

Accelerate

Megatron-LM

Job description

Job Description

About AI71

AI71 is an industry leader in artificial intelligence, delivering innovative solutions that empower developers, businesses and governments to solve complex challenges. AI71 builds secure, enterprise-ready applications powered by cutting-edge technology—tailored for knowledge workers and sector-specific needs. AI71 bridges the gap between advanced AI and real-world impact. Guided by a strong commitment to research and responsibility, we create transformative solutions that drive progress and empower communities.

The Role

As an MLOps Engineer you set the ML infrastructure and reliability strategy across AI71s platform, including how LLMs and other deep learning models are deployed, fine-tuned, and served at scale. You own architecture decisions across both SaaS and on-prem operating models, mentor engineers across teams, and drive multi-quarter ML infrastructure strategy. You are a force multiplier.

What Youll Do

• Define ML infrastructure architecture across the platform: model deployment strategy (vLLM, Triton, or TGI), pipeline engineering (MLflow or Kubeflow), and cloud-native infrastructure across major cloud platforms (AWS, Azure, or GCP)
• Set direction for ML system reliability: monitoring, latency / throughput / availability targets, and incident response across research and production environments.
• Mentor senior MLOps engineers; raise the operational bar across multiple teams.
• Drive cross-team initiatives that improve inference performance and cost-efficiency, including distributed training frameworks (DeepSpeed, FSDP, Accelerate).
• Partner with ML researchers, product, and engineering leadership on multi-quarter ML infrastructure strategy.
• Ensure ML infrastructure scales across managed SaaS and fully air-gapped on-prem deployments.

What Youll Bring

• 10+ years of MLOps, ML infrastructure, or machine learning engineering with history of architectural ownership.
• Proven track record architecting large-scale model deployment (including LLMs) and ML infrastructure at scale.
• Deep cloud expertise across major cloud platforms (AWS, Azure, or GCP) and strong Python proficiency
• Mentorship record — engineers you have grown now operate independently at higher levels.
• Deep comfort architecting ML systems that run in both managed SaaS and on-premises / disconnected air-gapped environments.
• Kubernetes at architectural depth — GPU scheduling, multi-tenancy, operators, and the failure modes of distributed workloads on shared clusters.
• Strong communication, stakeholder management, and decision-making skills, with a passion for building diverse, inclusive engineering teams.

Strong Preference

• Ownership of production reliability at platform level: SLO definition, incident command, postmortem practice, and driving reliability improvements across teams rather than services.
• Architecture-level experience with distributed training and fine-tuning at scale (DeepSpeed, FSDP, Megatron-LM), including cluster design, checkpointing strategy, and failure recovery.
• Deep GPU systems knowledge: CUDA, NCCL, interconnect topology (NVLink, InfiniBand/RoCE), and diagnosing performance and communication problems across nodes.
• Model optimization strategy at portfolio level: quantization (FP8, AWQ, GPTQ), speculative decoding, with measurable cost or latency outcomes across multiple systems.
• Experience in regulated or security-constrained environments — compliance-driven architecture, model governance, lineage, audit, and secrets management.
• On-prem / air-gap ML delivery architecture experience at scale.
• Track record maturing MLOps practice in a growing organization: standards, platform abstractions, and paved paths that outlived your involvement.
• Bare-metal GPU cluster architecture, including scheduling (Slurm or Kubernetes) and hardware lifecycle in customer or owned data centers.

Nice To Have

• Conference speaking, technical writing, or industry thought leadership.
• Open-source contributions to inference, serving, or ML infrastructure projects, particularly maintainer-level involvement.
• C/C++ or CUDA kernel experience for performance-critical paths.
• Arabic language skills.

Why AI71

• Mission-Driven Work: Work on cutting-edge AI applications with a talented and passionate team, solving real-world challenges in critical sectors.
• Unparalleled Opportunity: This is a chance to innovate and solve real-world challenges using AI at a company with unique access to world-leading models and resources.
• Career Growth: We offer competitive compensation, benefits, and significant career growth opportunities as a foundational member of the team.
• World-Class Environment: Enjoy a flexible working environment and the latest tools & technologies needed to do your best work.

Job Details

Role Level: Executive-Level Work Type: Full-Time Country: United Arab Emirates City: Abu Dhabi Company Website: https://ai71.ai/ Job Function: DevOps & QA Company Industry/ Sector: Technology Information and Internet