Senior MLOps & AI Infra Engineer (Remote)

SmartRecruitment.com

United States

Remote

USD 140,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

SmartRecruitment.com is seeking a Senior MLOps / AI Infrastructure Engineer to lead scalable ML infrastructure from model training to real-time inference. You will design systems supporting AI research and production environments, partnering with ML researchers, software engineers, and product teams to move models from prototype to production securely.

The role emphasizes building distributed training pipelines, low-latency model serving, and robust CI/CD for ML workflows, with cloud and

Qualifications

  • 4+ years of software engineering experience with at least 2 years in ML infrastructure or DevOps for AI/ML.
  • Proficient in Python and a systems language (Go, Rust, or similar).
  • Strong expertise in Kubernetes, Docker, and cloud infrastructure (GCP preferred).
  • Familiar with ML tooling such as PyTorch/TensorFlow, MLflow, Ray, or similar.
  • Experience deploying ML models in production at scale, preferably in containerized environments.

Responsibilities

  • Build and scale core ML infrastructure for distributed training, hyperparameter tuning, and experiment tracking.
  • Design and maintain containerized model-serving infrastructure for LLMs and multimodal models with low-latency requirements.
  • Develop CI/CD pipelines tailored to machine learning workflows using tools like MLflow, Airflow, or Kubeflow.
  • Optimize compute usage and resource allocation on cloud platforms (GCP or AWS) and Kubernetes clusters.
  • Implement observability and alerting systems for model performance, drift, and uptime in production.
  • Collaborate with cross-functional teams to productionize novel research models.

Skills

Python
Go/Rust
Kubernetes
Docker
Cloud platforms
ML tooling
Distributed systems
Observability
English proficiency

Tools

Kubeflow
Airflow
MLflow
Ray

Job description

SmartRecruitment.com is seeking a Senior MLOps / AI Infrastructure Engineer to lead scalable ML infrastructure from model training to real-time inference. You will design systems supporting AI research and production environments, partnering with ML researchers, software engineers, and product teams to move models from prototype to production securely.

The role emphasizes building distributed training pipelines, low-latency model serving, and robust CI/CD for ML workflows, with cloud and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior MLOps Architect for AI Production Systems (Remote)
Senior MLOps Architect for AI Production Systems (Remote)

Motion Recruitment • Cambridge (MA)

Remote
USD 180,000 - 240,000
Medical Insurance
Dental Benefits
Vision Benefits
+5
Senior MLOps / AI Infrastructure Engineer - iGaming - Remote
Senior MLOps / AI Infrastructure Engineer - iGaming - Remote

SmartRecruitment.com • United States

Remote
USD 140,000 - 210,000
Senior MLOps Engineer: Build Real-Time ML Platform, Hybrid
Senior MLOps Engineer: Build Real-Time ML Platform, Hybrid

PhillyTech.Co • King of Prussia (PA)

Hybrid
USD 165,000 - 175,000
Equity
Hybrid work model
Fully paid medical, dental, and vision
+2
Remote Senior MLOps Engineer: Build Production AI Pipelines
Remote Senior MLOps Engineer: Build Production AI Pipelines

clariticloudinc • United States

Remote
USD 105,000 - 140,000
Senior MLOps Engineer - Production AI Platform (Remote, ET)
Senior MLOps Engineer - Production AI Platform (Remote, ET)

Motion Recruitment • Massachusetts

Remote
USD 180,000 - 240,000
Medical Insurance
Dental Benefits
Vision Benefits
+5
Senior MLOps Engineer – Remote Production AI & LLMs
Senior MLOps Engineer – Remote Production AI & LLMs

Dynatron • United States

Remote
USD 150,000 - 230,000
Remote environment
Professional development
Ownership of production systems
+1
Senior MLOps Engineer: Scalable AI Infra & Deployment
Senior MLOps Engineer: Scalable AI Infra & Deployment

PathAI • Boston (MA)

Hybrid
USD 128,000 - 196,000
Senior Remote MLOps Leader for Production ML Systems
Senior Remote MLOps Leader for Production ML Systems

Jaggle.AI • United States

Remote
USD 170,000 - 290,000
Remote work options
Health insurance
Wellness benefits
+2
Senior AI Systems Engineer — Remote-Eligible MLOps Lead
Senior AI Systems Engineer — Remote-Eligible MLOps Lead

ARA • Raleigh (NC)

Hybrid
USD 150,000 - 210,000
Senior MLOps Engineer — Remote, Scalable ML Infra
Senior MLOps Engineer — Remote, Scalable ML Infra

Coinscapture • United States

Remote
USD 150,000 - 210,000
Equity participation
Pod ownership for every employee
Health, vision & dental insurance
+4