MLOps Engineer

Fathom.io

Dhahran Compound

On-site

SAR 180,000 - 260,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Fathom.io in Dhahran, Saudi Arabia seeks a mid-to-senior MLOps engineer to build the intelligence layer of our AI platform. You’ll shape infrastructure for model deployment, training, notebooks, and RAG pipelines, with a focus on self-service, reliability, and scalable workflows.

You’ll collaborate with backend, product, and AI teams to turn complex systems into approachable platform features, while optimizing GPU deployments and ensuring multi-tenant security.

Qualifications

  • Strong experience in MLOps, AI platform engineering, machine learning infrastructure, or distributed systems.
  • Hands-on Kubernetes experience, including deploying and operating stateful, training, notebook, serverless, or GPU-intensive workloads.
  • Experience building ML platforms that support some combination of training, experimentation, notebooks, feature/data workflows, model registries, and production serving.
  • Experience with model serving frameworks such as KServe, vLLM, Triton, Ray Serve, or similar.
  • Familiarity with ML lifecycle tooling such as MLflow, experiment tracking, model registries, and CI/CD or GitOps for ML systems.
  • Practical experience optimizing training and inference workloads for latency, throughput, availability, and cost.
  • Understanding of GPU scheduling, resource allocation, model quantization, batching, autoscaling, and multi-model serving.
  • Experience with RAG systems, LLM applications, AI agents, or their supporting infrastructure.
  • Strong software engineering fundamentals and a product-minded approach to platform design.
  • Ability to make complex operational workflows reliable and approachable for users.

Responsibilities

  • Design and build the infrastructure powering our Intelligence layer.
  • Enable reliable, automated workflows for model training, deployment, lifecycle management, and inference.
  • Build scalable foundations for users to create, configure, and operate AI agents and RAG pipelines through the platform UI.
  • Develop the platform capabilities behind managed notebooks, functions, experiments, training jobs, model registries, and serving endpoints.
  • Improve model serving, observability, versioning, evaluation, promotion, and rollback capabilities.
  • Optimize GPU inference and training deployments for performance, reliability, and cost efficiency.
  • Explore efficient approaches for deploying models across centralized GPU infrastructure and edge devices.
  • Automate workflows that otherwise require manual MLOps effort, with a focus on safe, self-service capabilities for platform users.
  • Partner with backend, product, and AI teams to turn complex infrastructure into intuitive platform features.
  • Help define standards for security, multi-tenancy, resource isolation, model governance, and operational reliability.

Skills

MLOps experience
AI platform engineering
Distributed systems
Kubernetes
KServe
vLLM
MLflow
LangFuse
Rust
Performance optimization

Tools

KServe
vLLM
Triton
Ray Serve
MLflow
Kubeflow Notebooks
JupyterHub

Job description

About The Role

We're looking for a mid-to-senior MLOps engineer to help build the intelligence layer of our AI platform. This is not a traditional MLOps role focused only on maintaining pipelines and deployments. You will help create the underlying infrastructure that makes sophisticated AI workflows accessible through a simple, self-service product experience: model deployment, training, notebooks, functions, UI-driven agent creation, and RAG pipelines. You'll work at the intersection of platform engineering, machine learning infrastructure, distributed systems, and developer experience.

What You'll Do
  • Design and build the infrastructure powering our Intelligence layer.
  • Enable reliable, automated workflows for model training, deployment, lifecycle management, and inference.
  • Build scalable foundations for users to create, configure, and operate AI agents and RAG pipelines through the platform UI.
  • Develop the platform capabilities behind managed notebooks, functions, experiments, training jobs, model registries, and serving endpoints.
  • Improve model serving, observability, versioning, evaluation, promotion, and rollback capabilities.
  • Optimize GPU inference and training deployments for performance, reliability, and cost efficiency.
  • Explore efficient approaches for deploying models across centralized GPU infrastructure and edge devices.
  • Automate workflows that otherwise require manual MLOps effort, with a focus on safe, self-service capabilities for platform users.
  • Partner with backend, product, and AI teams to turn complex infrastructure into intuitive platform features.
  • Help define standards for security, multi-tenancy, resource isolation, model governance, and operational reliability.
Our current stack
You'll Work With Technologies Including
  • Kubernetes and Knative
  • KServe and vLLM
  • MLflow
  • LangFuse
  • GPU infrastructure and model-serving workloads
  • RAG architectures, vector retrieval, agent workflows, and LLM applications

Our intelligence backend is built in Rust, so Rust experience is a strong advantage.

What We're Looking For
  • Strong experience in MLOps, AI platform engineering, machine learning infrastructure, or distributed systems.
  • Hands-on Kubernetes experience, including deploying and operating stateful, training, notebook, serverless, or GPU-intensive workloads.
  • Experience building ML platforms that support some combination of training, experimentation, notebooks, feature/data workflows, model registries, and production serving.
  • Experience with model serving frameworks such as KServe, vLLM, Triton, Ray Serve, or similar.
  • Familiarity with ML lifecycle tooling such as MLflow, experiment tracking, model registries, and CI/CD or GitOps for ML systems.
  • Practical experience optimizing training and inference workloads for latency, throughput, availability, and cost.
  • Understanding of GPU scheduling, resource allocation, model quantization, batching, autoscaling, and multi-model serving.
  • Experience with RAG systems, LLM applications, AI agents, or their supporting infrastructure.
  • Strong software engineering fundamentals and a product-minded approach to platform design.
  • Ability to make complex operational workflows reliable and approachable for users.
Nice to have
  • Rust experience or interest in working with Rust-based backend systems.
  • Experience running notebook environments such as JupyterHub, Kubeflow Notebooks, VS Code Server, or equivalent.
  • Experience creating secure, scalable execution environments for user-defined functions or jobs.
  • Experience deploying AI workloads on edge devices.
  • Familiarity with model optimization techniques, including quantization, compilation, pruning, and hardware-aware serving.
  • Experience with multi-tenant AI platforms, security controls, and model governance.
  • Familiarity with observability and evaluation tooling for ML and LLM systems.
What Success Looks Like

You will help us evolve from manually operated AI infrastructure to a platform where users can train, evaluate, deploy, and operate models; work in managed notebooks; run functions; create agents; and configure RAG workflows - with the platform handling as much of the operational complexity as possible.

By submitting this application, I agree that my personal data will be collected, processed, and retained by the company solely for the purposes of managing and assessing my candidacy.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Machine Learning Engineer
Machine Learning Engineer

Infinniti • Riyadh

On-site
SAR 360,000 - 540,000
Senior AI Engineer: Agentic AI & Enterprise RAG Architect
Senior AI Engineer: Agentic AI & Enterprise RAG Architect

Codeninja • Riyadh

On-site
SAR 300,000 - 600,000
Competitive compensation
Professional growth opportunities
Collaborative environment
Senior AI Engineer / Agentic AI Architect
Senior AI Engineer / Agentic AI Architect

CodeNinja • Riyadh

On-site
SAR 300,000 - 600,000
Competitive compensation
Professional growth opportunities
Collaborative environment
Senior Software Engineer, AI Platform
Senior Software Engineer, AI Platform

Mirai Arabian International Company Limited • Riyadh

On-site
SAR 350,000 - 550,000
Phone allowance
Health insurance
Performance bonus
+1
Data Scientist — GenAI, LLMs, & MLOps
Data Scientist — GenAI, LLMs, & MLOps

Eram Talent • Dhahran Compound

On-site
SAR 180,000 - 300,000
Senior ML Platform Engineer, Inference & MLOps
Senior ML Platform Engineer, Inference & MLOps

Mollkom • Riyadh

Hybrid
SAR 150,000 - 210,000
AI Platform Developer
AI Platform Developer

Valleysoft • Riyadh

On-site
SAR 300,000 - 520,000
Private Health Insurance
Training & Development
Machine Learning Engineer
Machine Learning Engineer

Nakhla • Riyadh

On-site
SAR 149,981 - 224,971
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Norconsult Telematics • Riyadh

On-site
SAR 240,000 - 420,000
Senior DevOps Engineer
Senior DevOps Engineer

Lucidya | لوسيديا • Saudi Arabia

On-site
SAR 180,000 - 320,000