Senior AI Infra Engineer — Platform, GPUs & MLOps

Mozn

United States

Remote

USD 140,000 - 210,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Top-tier health insurance
Enabling culture
Dynamic workplace
Diversity & inclusion

Job summary

Mozn is seeking an AI Infrastructure Engineer III to join our Cloud Engineering team. You will design and operate scalable AI platforms for data scientists and ML engineers, deploying Kubeflow, MLflow, KServe, Ray, and similar tools.

The role emphasizes GPU clusters, Terraform-based automation, and robust model serving in cloud-native and hybrid environments. You will collaborate with ML researchers to optimize GPU utilization, implement CI/CD for ML workloads, and monitor system health with

Qualifications

  • 4–6 years in AI Infrastructure, MLOps, or Cloud/Platform Engineering.
  • Hands-on Kubernetes experience is essential.
  • Experience with Kubeflow, MLflow, or similar ML platforms.
  • Experience operating GPU infrastructure for AI workloads.
  • Strong knowledge of NVIDIA GPUs, CUDA, and GPU optimization.
  • Experience with distributed training workloads and model serving.

Responsibilities

  • Design, deploy, and operate enterprise AI/ML platforms.
  • Build self-service platforms for data scientists and ML engineers.
  • Deploy Kubeflow, MLflow, KServe, Ray, or similar AI platforms.
  • Design infrastructure for training, experimentation, and inference.
  • Build scalable model serving infrastructure.

Skills

Kubernetes
Python scripting
Go programming
GitOps
Linux/Unix

Tools

Kubeflow
MLflow
KServe
Ray
Terraform
Helm
Ansible
Prometheus
Grafana
OpenTelemetry
ELK/OpenSearch

Job description

Mozn is seeking an AI Infrastructure Engineer III to join our Cloud Engineering team. You will design and operate scalable AI platforms for data scientists and ML engineers, deploying Kubeflow, MLflow, KServe, Ray, and similar tools.

The role emphasizes GPU clusters, Terraform-based automation, and robust model serving in cloud-native and hybrid environments. You will collaborate with ML researchers to optimize GPU utilization, implement CI/CD for ML workloads, and monitor system health with

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Infrastructure Engineer III
AI Infrastructure Engineer III

Mozn • United States

Remote
USD 140,000 - 210,000
Competitive compensation
Top-tier health insurance
Enabling culture
+2
AI Platform Engineer: GPU Infra & MLOps
AI Platform Engineer: GPU Infra & MLOps

ICE Clear Europe Limited • Georgia

Hybrid
USD 140,000 - 200,000
Senior MLOps Engineer: GPU AI Infra & Production
Senior MLOps Engineer: GPU AI Infra & Production

Blue Signal Search • Santa Clara (CA)

On-site
USD 140,000 - 190,000
Advanced GPU infra exposure
Collaborative engineering culture
Open source AI frameworks access
+2
AI/ML Platform Engineer
AI/ML Platform Engineer

First Soft Solutions LLC • Baltimore (MD)

On-site
USD 150,000 - 230,000
Production AI Infra Lead & MLOps Engineer
Production AI Infra Lead & MLOps Engineer

CloudWizz • United States

Remote
USD 140,000 - 200,000
Senior AI Platform Engineer | Cloud-Native MLOps (Remote)
Senior AI Platform Engineer | Cloud-Native MLOps (Remote)

Bright Vision Technologies • United States

Remote
USD 130,000 - 180,000
MLOps Engineer
MLOps Engineer

Blue Signal Search • Santa Clara (CA)

On-site
USD 140,000 - 190,000
Advanced GPU infra exposure
Collaborative engineering culture
Open source AI frameworks access
+2
Remote AI Infrastructure Engineer (GPU/MLOps)
Remote AI Infrastructure Engineer (GPU/MLOps)

Software • United States

Remote
USD 95,000 - 155,000
Health, dental, and vision insurance
100% remote work
Flexible working arrangements
+4
ML Platform Engineer — Build Scalable AI Infra & Inference
ML Platform Engineer — Build Scalable AI Infra & Inference

Not Specified • United States

Remote
USD 140,000 - 180,000
ML Platform Engineer
ML Platform Engineer

Foundry AI Partners • United States

On-site
USD 120,000 - 160,000