Senior MLOps Engineer

Salvo Software

United States

Remote

USD 150,000 - 210,000

Full time

13 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Salvo Software seeks a Senior MLOps Engineer to design, build, and own the infrastructure for machine learning and LLM-powered systems. You will create reliable pipelines, model registries, automated deployment, scalable inference, and monitoring across cloud, on-prem, and air-gapped environments.

This senior, hands-on role defines MLOps standards and platform architecture, guides AI Developers and RAG Engineers, and collaborates with engineering, product, and clients to ensure reproducibility,

Qualifications

  • 5+ years in DevOps/SRE/platform engineering with production ML experience.
  • Hands-on with ML tooling and LLM inference engines.
  • Strong Linux, containers, and cloud fundamentals are essential.

Responsibilities

  • Design, deploy, and operate MLOps platform infrastructure and LLM inference pipelines.
  • Build CI/CD, IaC, and monitoring to support RAG apps and production deployments.
  • Troubleshoot production issues with AI engineering teams.

Skills

Linux admin
Docker
Kubernetes
Terraform
Ansible
GitHub Actions
Azure DevOps
Prometheus
Grafana
Python
Bash
Security fundamentals
Networking
OAuth2/OIDC
Zero Trust
ML tooling
Ollama
vLLM
GPU infra

Tools

Terraform
Ansible
GitHub Actions
Azure DevOps
Prometheus
Grafana
Airflow
Kafka
CUDA/NVIDIA
Proxmox/VMware

Job description

Salvo Software is a global technology company specializing in custom software development and advanced engineering solutions. With distributed teams across the US, LATAM, and India, we partner with clients to build high-performance, scalable systems that solve complex technical challenges. Our culture values innovation, ownership, and engineering excellence. We’re growing our AI department and are looking for a Senior MLOps Engineer to build the platform that takes our models and LLM systems reliably into production.

Role Overview

We are looking for a Senior MLOps Engineer to design, build, and own the infrastructure and workflows behind our machine learning and LLM-powered systems. Your core work will be creating a reliable path from experimentation to production: training and fine-tuning pipelines, model registries, automated deployment, scalable inference, and monitoring for models running in cloud, on-prem, and air-gapped environments.

This is a senior, hands-on role. You’ll define MLOps standards and platform architecture, make key decisions on reliability, scalability, and cost, and provide technical guidance to AI Developers and RAG Engineers on the team. You’ll work closely with engineering, product, and client stakeholders to make sure AI features are reproducible, observable, secure, and ready to scale.

Key Responsibilities
MLOps Platform & Engineering (core focus)
  • Design, deploy, and operate MLOps platform infrastructure, cloud services (AWS, Azure, GCP), and LLM inference pipelines (Ollama, vLLM).
  • Build automated CI/CD pipelines, IaC, and monitoring/alerting systems to support RAG applications, AI agents, and production deployments.
  • Manage Linux servers, networking, security endpoints, and troubleshoot production issues alongside AI engineering teams.
Technical Leadership
  • Establish department-wide MLOps/DevOps standards, best practices, and reusable infrastructure templates.
  • Partner with AI Developers and RAG Engineers to guide architecture, deployment strategies, tool selection, and production readiness.
  • Translate feature requirements into reliable, secure, cost-effective infrastructure and maintain comprehensive system documentation.
Infrastructure & Operations
  • Provision containerized workloads, Linux servers, and infrastructure using IaC (Terraform, Ansible) across cloud and on-prem environments.
  • Manage CI/CD (GitHub Actions, Azure DevOps), observability tools (Prometheus, Grafana), secure networking, and GPU-enabled hardware.
  • Troubleshoot platform incidents, perform root cause analysis, and maintain operational resilience.
  • 5+ years of senior-level experience in DevOps/SRE/platform engineering with at least 1 year deploying ML models and LLM inference engines (Ollama, vLLM) in production.
  • Proficiency with Linux, Docker, Kubernetes, virtualization (Proxmox, VMware), GPU infrastructure (CUDA/NVIDIA), and major cloud platforms (AWS, Azure, GCP).
  • Hands-on expertise with Infrastructure as Code (Terraform, Ansible), CI/CD platforms (GitHub Actions, Azure DevOps), Bash, and Python scripting.
  • Solid background in core networking (DNS, TLS, firewalls, VPNs), monitoring/logging, and security/authentication (OAuth2/OIDC, API gateways, Zero Trust/SOC 2).
  • Familiarity with ML tooling (MLflow, Kubeflow), vector DBs, RAG/agent frameworks (MCP), workflow orchestration (Airflow/Kafka), and model optimization/quantization.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior MLOps Platform Engineer
Senior MLOps Platform Engineer

Salvo Software • United States

Remote
USD 150,000 - 210,000
AI Developer
AI Developer

Salvo Software • United States

Hybrid
USD 110,000 - 180,000
AI Developer
AI Developer

Salvo Software • Washington

Remote
USD 120,000 - 180,000
MLOps Engineer
MLOps Engineer

Sierracorp • San Francisco (CA)

On-site
USD 100,000 - 150,000
AI Developer
AI Developer

MinutePay Inc. • United States

Remote
USD 120,000 - 180,000
MLOps Engineer
MLOps Engineer

Compunnel Inc. • San Antonio (TX)

On-site
USD 100,000 - 130,000
Senior MLOps Engineer
Senior MLOps Engineer

AppRecode, Inc. • Town of Middletown (NY)

Remote
USD 120,000 - 160,000
MLOps Engineer
MLOps Engineer

Codinix Technologies Inc. • San Francisco (CA)

On-site
USD 120,000 - 150,000
Senior LLMOps Engineer
Senior LLMOps Engineer

UNAVAILABLE • McLean (VA)

On-site
USD 180,000 - 240,000
Senior Machine Learning Operations MLOps Engineer
Senior Machine Learning Operations MLOps Engineer

Symphony Solutions • Cincinnati (OH)

Hybrid
USD 140,000 - 210,000
Competitive salary
Flexible schedule
Training & development
+1