AI Infrastructure Engineer III

Mozn

United States

Remote

USD 140,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Top-tier health insurance
Enabling culture
Dynamic workplace
Diversity & inclusion

Job summary

Mozn is seeking an AI Infrastructure Engineer III to join our Cloud Engineering team. You will design and operate scalable AI platforms for data scientists and ML engineers, deploying Kubeflow, MLflow, KServe, Ray, and similar tools.

The role emphasizes GPU clusters, Terraform-based automation, and robust model serving in cloud-native and hybrid environments. You will collaborate with ML researchers to optimize GPU utilization, implement CI/CD for ML workloads, and monitor system health with

Qualifications

  • 4–6 years in AI Infrastructure, MLOps, or Cloud/Platform Engineering.
  • Hands-on Kubernetes experience is essential.
  • Experience with Kubeflow, MLflow, or similar ML platforms.
  • Experience operating GPU infrastructure for AI workloads.
  • Strong knowledge of NVIDIA GPUs, CUDA, and GPU optimization.
  • Experience with distributed training workloads and model serving.

Responsibilities

  • Design, deploy, and operate enterprise AI/ML platforms.
  • Build self-service platforms for data scientists and ML engineers.
  • Deploy Kubeflow, MLflow, KServe, Ray, or similar AI platforms.
  • Design infrastructure for training, experimentation, and inference.
  • Build scalable model serving infrastructure.

Skills

Kubernetes
Python scripting
Go programming
GitOps
Linux/Unix

Tools

Kubeflow
MLflow
KServe
Ray
Terraform
Helm
Ansible
Prometheus
Grafana
OpenTelemetry
ELK/OpenSearch

Job description

About Mozn

MOZN is a leading Enterprise AI company enabling organizations to make informed decisions in two critical domains: Financial Crime Prevention and Enterprise Knowledge Intelligence. We’re a diverse, collaborative team of innovators united by a shared purpose: to build AI that delivers tangible business value, builds trust, and empowers people and organizations with augmented intelligence. Our culture is built on the relentless pursuit of excellence and meaningful impact. If you’re passionate about working alongside exceptional talent on world-class AI, and you want the autonomy and runway to do the best work of your career, join us in shaping the future of intelligent enterprises.

About the role

We are looking for a highly motivated AI Infrastructure Engineer III to join our Cloud Engineering team. The ideal candidate is passionate about building scalable AI infrastructure that enables machine learning engineers and data scientists to efficiently develop, train, deploy, and operate AI models. This role focuses on designing, operating, automating, and continuously improving AI platform capabilities including Kubeflow, MLflow, GPU infrastructure, distributed training platforms, model serving infrastructure, and MLOps tooling across cloud-native and hybrid environments. The ideal candidate possesses deep expertise in AI infrastructure and GPU platforms. Kubernetes and cloud platform experience are essential enablers, but the primary focus is building highly optimized infrastructure for AI and machine learning workloads.

What you’ll do
AI Platform Engineering
  • Design, deploy, and operate enterprise AI/ML platforms.
  • Build self-service platforms for Data Scientists and ML Engineers.
  • Deploy and operate Kubeflow, MLflow, KServe, Ray, or similar AI platforms.
  • Design infrastructure supporting model training, experimentation, feature engineering, and inference.
  • Build highly available and scalable model serving infrastructure.
GPU Infrastructure
  • Design and operate GPU clusters for large-scale AI workloads.
  • Optimize GPU scheduling, utilization, sharing, autoscaling, and resource allocation.
  • Deploy and manage NVIDIA GPU Operator and GPU-enabled Kubernetes environments.
  • Optimize distributed GPU training performance across multi-node clusters.
  • Troubleshoot AI infrastructure performance bottlenecks.
MLOps & Platform Automation
  • Build CI/CD pipelines for ML workloads.
  • Automate AI infrastructure provisioning using Infrastructure as Code.
  • Implement monitoring and observability for GPU utilization, model serving, training jobs, and inference latency.
  • Collaborate closely with Data Science teams to improve platform usability, performance, and reliability.
Requirements
  • 4-6 years of experience in AI Infrastructure, MLOps, Platform Engineering, or Cloud Engineering.
  • Strong hands‑on experience with Kubernetes.
  • Experience with Kubeflow, MLflow, or similar ML platform technologies.
  • Experience operating GPU infrastructure for AI workloads.
  • Strong understanding of NVIDIA GPU technologies, CUDA fundamentals, and GPU optimization.
  • Experience supporting distributed training workloads.
  • Experience with model serving platforms such as KServe, Triton Inference Server, Ray Serve, or similar.
  • Experience with AWS, GCP, OCI, or Azure AI platforms.
  • Experience automating infrastructure using Terraform, Helm, GitOps, or Ansible.
  • Strong scripting or programming skills in Python, Bash, or Go.
  • Experience with Prometheus, Grafana, OpenTelemetry, ELK/OpenSearch, or equivalent observability platforms.
Preferred Qualifications
  • Experience with PyTorch, TensorFlow, Hugging Face, or JAX.
  • Experience with distributed training frameworks such as Ray, DeepSpeed, Horovod, or NCCL.
  • Experience with Vector Databases, LLM infrastructure, RAG architectures, or GenAI platforms.
  • Experience operating inference platforms for large language models.
  • Experience supporting AI research or Data Science teams in production environments.
  • Contributions to Cloud Native, Kubernetes, AI, or ML open-source communities.
  • Cloud, Kubernetes, NVIDIA, or AI/ML certifications are a plus.
Benefits
  • You will be at the forefront of an exciting time for the Middle East, joining a high‑growth rocket‑ship in an exciting space
  • You will be given a lot of responsibility and trust. We believe that the best results come when the people responsible for a function are given the freedom to do what they think is best
  • The fundamentals will be taken care of: competitive compensation, top‑tier health insurance and an enabling culture so that you can focus on what you do best
  • You will enjoy a fun and dynamic workplace working alongside some of the greatest minds in AI
  • We believe strength lies in difference, embracing all for who they are and empowered to be the best version of themselves
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infra Engineer — Platform, GPUs & MLOps
Senior AI Infra Engineer — Platform, GPUs & MLOps

Mozn • United States

Remote
USD 140,000 - 210,000
Competitive compensation
Top-tier health insurance
Enabling culture
+2
AI Engineer, AIOps & Infrastructure
AI Engineer, AIOps & Infrastructure

Eloquent AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
AI Infrastructure Specialist
AI Infrastructure Specialist

Ali Aydi • United States

Remote
USD 95,000 - 155,000
100% remote work
Health insurance
Paid time off
Senior Site Reliability Engineer
Senior Site Reliability Engineer

Mozn • United States

Remote
USD 140,000 - 180,000
Competitive compensation
Top-tier health insurance
Dynamic, AI-focused workplace
AI Platform Support Engineer: Kubernetes, GPUs & ML Infra
AI Platform Support Engineer: Kubernetes, GPUs & ML Infra

Lightning AI • New York (NY)

Hybrid
USD 115,000 - 140,000
Health coverage
Equity (RSUs)
401(k) matching
+3
Engineering Manager
Engineering Manager

Mozn • United States

Remote
USD 180,000 - 230,000
Competitive compensation
Top-tier health insurance
Enabling culture
+2
Software Engineer, Infrastructure
Software Engineer, Infrastructure

Fudo Partners • New York (NY)

On-site
USD 180,000 - 240,000
Medical, dental and vision coverage
Flexible paid time off
Winter break
+3
Member of Technical Staff - Training Platform
Member of Technical Staff - Training Platform

Prime Intellect • United States

Remote
USD 150,000 - 300,000
Cash compensation $150K–$300K with equ
Flexible work arrangement (remote or S
Visa sponsorship and relocation
+3
Lead AI Infra Architect – GPU Cloud & ML Pipelines Equity
Lead AI Infra Architect – GPU Cloud & ML Pipelines Equity

Hamilton Barnes • Texas

On-site
USD 283,500 - 346,500
Equity (RSUs)
AI/ML Engineer
AI/ML Engineer

intelycore • United States

Hybrid
USD 100,000 - 140,000
Competitive salary & benefits
Flexible work environment
Access to latest tools and resources