Senior MLOps / AI Infrastructure Engineer - iGaming - Remote

SmartRecruitment.com

United States

Remote

USD 140,000 - 210,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

SmartRecruitment.com is seeking a Senior MLOps / AI Infrastructure Engineer to lead scalable ML infrastructure from model training to real-time inference. You will design systems supporting AI research and production environments, partnering with ML researchers, software engineers, and product teams to move models from prototype to production securely.

The role emphasizes building distributed training pipelines, low-latency model serving, and robust CI/CD for ML workflows, with cloud and

Qualifications

  • 4+ years of software engineering experience with at least 2 years in ML infrastructure or DevOps for AI/ML.
  • Proficient in Python and a systems language (Go, Rust, or similar).
  • Strong expertise in Kubernetes, Docker, and cloud infrastructure (GCP preferred).
  • Familiar with ML tooling such as PyTorch/TensorFlow, MLflow, Ray, or similar.
  • Experience deploying ML models in production at scale, preferably in containerized environments.

Responsibilities

  • Build and scale core ML infrastructure for distributed training, hyperparameter tuning, and experiment tracking.
  • Design and maintain containerized model-serving infrastructure for LLMs and multimodal models with low-latency requirements.
  • Develop CI/CD pipelines tailored to machine learning workflows using tools like MLflow, Airflow, or Kubeflow.
  • Optimize compute usage and resource allocation on cloud platforms (GCP or AWS) and Kubernetes clusters.
  • Implement observability and alerting systems for model performance, drift, and uptime in production.
  • Collaborate with cross-functional teams to productionize novel research models.

Skills

Python
Go/Rust
Kubernetes
Docker
Cloud platforms
ML tooling
Distributed systems
Observability
English proficiency

Tools

Kubeflow
Airflow
MLflow
Ray

Job description

Location: Remote

About the Role

We're a fast-growing Bay Area AI company building cutting-edge products powered by large-scale machine learning models.

We're looking for a Senior MLOps / AI Infrastructure Engineer to lead the development of robust, scalable infrastructure that supports everything from model training to real-time inference.

You will play a critical role in designing systems that power our AI research and production environments, working closely with ML researchers, software engineers, and product teams to ensure models move quickly from prototype to production - reliably and securely.

Job Responsibilities
  • Build and scale core ML infrastructure for distributed training, hyperparameter tuning, and experiment tracking.
  • Design and maintain containerized model-serving infrastructure for LLMs and multimodal models with low-latency requirements.
  • Develop CI/CD pipelines tailored to machine learning workflows using tools like MLflow, Airflow, or Kubeflow.
  • Optimize compute usage and resource allocation on cloud platforms (GCP or AWS) and Kubernetes clusters.
  • Implement observability and alerting systems for model performance, drift, and uptime in production.
  • Collaborate with cross-functional teams to productionize novel research models.
The Successful Candidate
  • 4+ years of software engineering experience, with at least 2 years in ML infrastructure or DevOps for AI/ML.
  • Proficient in Python and one systems language (Go, Rust, or similar).
  • Strong expertise in Kubernetes, Docker, and cloud infrastructure (GCP preferred).
  • Familiar with ML tooling such as PyTorch/TensorFlow, MLflow, Ray, or similar.
  • Experience deploying ML models in production at scale, preferably in containerized environments.
  • Strong understanding of distributed systems, resource orchestration, and observability.
  • Proficiency in English; Mandarin is a plus.
Nice to Have
  • Experience serving large foundation models (LLMs, vision-language, etc.).
  • Exposure to RAG architectures, vector search, or fine-tuning of open-source models.
  • Familiarity with infrastructure-as-code tools (Terraform, Helm).
  • Contributions to MLOps open-source tools or whitepapers.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior MLOps & AI Infra Engineer (Remote)
Senior MLOps & AI Infra Engineer (Remote)

SmartRecruitment.com • United States

Remote
USD 140,000 - 210,000
Lead Machine Learning / MLOps Engineer
Lead Machine Learning / MLOps Engineer

EPAM Systems • United States

On-site
USD 120,000 - 190,000
MLOps Engineer - Scalable ML Pipelines & CI/CD
MLOps Engineer - Scalable ML Pipelines & CI/CD

Codinix Technologies Inc. • California

On-site
Confidential
MLOps Engineer: Scalable ML Pipelines & Infra
MLOps Engineer: Scalable ML Pipelines & Infra

Compunnel Inc. • San Antonio (TX)

On-site
Confidential
AI Engineer, AIOps & Infrastructure
AI Engineer, AIOps & Infrastructure

Eloquent AI • San Francisco (CA)

On-site
USD 120,000 - 160,000
MLOps Engineer
MLOps Engineer

Blue Signal Search • Santa Clara (CA)

On-site
USD 140,000 - 190,000
Advanced GPU infra exposure
Collaborative engineering culture
Open source AI frameworks access
+2
MLOps Engineer MLOps Engineer
MLOps Engineer MLOps Engineer

Kurai • Austin (TX)

On-site
USD 140,000 - 190,000
Senior AI Engineer: Scalable LLMs & MLOps Leader
Senior AI Engineer: Scalable LLMs & MLOps Leader

Compunnel Inc. • San Francisco (CA)

On-site
USD 120,000 - 160,000
MLOps Engineer
MLOps Engineer

Sierracorp • San Francisco (CA)

On-site
USD 100,000 - 150,000
Senior Machine Learning Operations MLOps Engineer
Senior Machine Learning Operations MLOps Engineer

Symphony Solutions • Cincinnati (OH)

Hybrid
USD 140,000 - 210,000
Competitive salary
Flexible schedule
Training & development
+1