MLOps Engineer: Foundation Models Infra

Mohamed bin Zayed University of Artificial Intelligence; Sunnyvale (CA); On-site; USD 150,000 - 450,000; Full time

Benefits offered by this job

Comprehensive medical, dental, and vis

Bonus

401K Plan

Generous paid time off, sick leave and

Paid Parental Leave

Employee Assistance Program

Life insurance and disability

Job summary

Mohamed bin Zayed University of Artificial Intelligence is seeking a Machine Learning Engineer focused on ML infrastructure and MLOps. You will design, build, and operate scalable cloud infrastructure to support researchers, data pipelines, experimentation, and evaluation workflows.

You will balance rapid research needs with production-grade systems, ensuring scalable, reliable infrastructure and observability across platforms.

Qualifications

• 3+ years of MLOps, ML infra, or related backend roles.
• Experience with AWS compute, storage, and access control.
• Experience designing and operating distributed systems (Kubernetes, Ray).
• Strong Python, Docker, and Git skills.
• Familiarity with data processing pipelines (Spark, Kafka).
• Observability: monitoring, logging, alerting.
• Ability to translate researcher needs into production systems.

Responsibilities

• Design, build, and operate scalable ML infrastructure on AWS (compute, storage, networking, access control).
• Develop and maintain MLOps workflows for data versioning.
• Build and manage distributed systems for large-scale data processing and model evaluation.
• Own architecture decisions for ML infrastructure and drive reliability, scalability, cost efficiency.
• Implement observability across systems: monitoring, logging, alerting.
• Integrate OpenWebUI, Gradio, or similar UIs for data quality assurance.
• Build and maintain dashboards for experiment tracking and system health.
• Partner with researchers to translate experimental workflows into robust systems.

Skills

MLOps

AWS

Distributed systems

Python

System design

Data pipelines

Tools

Kubernetes

Ray

Spark

Kafka

Docker

Git

Job description

Mohamed bin Zayed University of Artificial Intelligence is seeking a Machine Learning Engineer focused on ML infrastructure and MLOps. You will design, build, and operate scalable cloud infrastructure to support researchers, data pipelines, experimentation, and evaluation workflows.

You will balance rapid research needs with production-grade systems, ensuring scalable, reliable infrastructure and observability across platforms.