Senior MLOps Engineer

Eurosoft

United States

Remote

USD 180,000 - 240,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Eurosoft is seeking an experienced MLOps/ML platform engineer to keep models dependable in production on client GPU infrastructure. You will operate and scale serving, scheduling, and lifecycle systems behind private language model and retrieval-augmented generation platforms for enterprise clients in South Korea.

Responsibilities include deploying on GPU clusters, building data/training pipelines, managing model versions, and monitoring latency and cost in on-prem environments.

Qualifications

  • 5+ years of experience in MLOps or ML platform engineering.
  • Production experience with model serving on GPU clusters.
  • Experience building data, training, and evaluation pipelines.
  • Ability to monitor latency, cost and quality for on-prem deployments.

Responsibilities

  • Deploy and operate models on GPU clusters with reliable serving and scheduling.
  • Build pipelines for data prep, training, and evaluation.
  • Manage model versions and controlled releases.
  • Monitor production latency, infra cost, and model quality in on-prem environments.
  • Collaborate with a small team on client-facing platform deployments.

Skills

MLOps
ML Platform
GPU Scheduling
Kubernetes

Tools

vLLM
Triton
Kubernetes

Job description

Role overview

Keep machine learning models dependable and observable in production on client GPU infrastructure. You'll build and operate the serving, scheduling, and lifecycle systems behind private language model and retrieval-augmented generation platforms used by enterprise clients in South Korea.

Responsibilities
  • Deploy and operate models on GPU clusters, with attention to reliable serving and resource scheduling.
  • Build pipelines for data preparation, model training, and evaluation.
  • Manage model versions and support controlled releases.
  • Monitor production latency, infrastructure cost, and model quality in on-premise environments.
  • Work closely with a small, experienced team on client-facing platform deployments.
Requirements
  • At least five years of experience in MLOps or ML platform engineering.
  • Production experience with model serving and GPU scheduling, using tools such as vLLM, Triton, or Kubernetes.
  • Experience building data, training, and evaluation pipelines and managing model versions.
  • Ability to monitor and troubleshoot latency, cost, and quality for on-premise deployments.
  • Valid residency in South Korea; a residence card or ID card is required with the application.
  • Working English; Korean is helpful.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior MLOps Engineer: GPU ML Platform & Deployment
Senior MLOps Engineer: GPU ML Platform & Deployment

Eurosoft • United States

Remote
USD 180,000 - 240,000
MLOps Engineer
MLOps Engineer

Blue Signal Search • Santa Clara (CA)

On-site
USD 140,000 - 190,000
Advanced GPU infra exposure
Collaborative engineering culture
Open source AI frameworks access
+2
MLOps Engineer
MLOps Engineer

BrothersTech • United States

On-site
USD 120,000 - 190,000
MLOps Engineer
MLOps Engineer

InfoVision Inc. • Irving (TX)

On-site
USD 100,000 - 130,000
MLOps Engineer
MLOps Engineer

Soledad Data Solutions • California

On-site
USD 140,000 - 210,000
Senior MLOps Engineer
Senior MLOps Engineer

Xident • United States

Remote
USD 160,000 - 210,000
Remote MLOps Engineer: GPU, vLLM & Kubernetes
Remote MLOps Engineer: GPU, vLLM & Kubernetes

Eurosoft • United States

Remote
USD 140,000 - 190,000
Remote-first
Hybrid option in Tashkent
USD salary
MLOps Engineer MLOps Engineer
MLOps Engineer MLOps Engineer

Kurai • Austin (TX)

On-site
USD 140,000 - 190,000
Senior ML Operations Engineer II - Monetization
Senior ML Operations Engineer II - Monetization

Fetch • United States

Remote
USD 150,000 - 210,000
Machine Learning Engineer
Machine Learning Engineer

distil labs • United States

Remote
USD 180,000 - 240,000
Remote work within European time zones
Significant ownership of technical-dec
Production-ready ML systems