Senior MLOps Engineer — On-Prem GPU & LLM Deployments

Eurosoft

United States

Remote

USD 140,000 - 190,000

Full time

46 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Direct access to executive leadership
Market-level compensation based on经验

Job summary

Eurosoft is seeking an experienced engineer to build and operate ML systems on customer GPU clusters, ensuring reliable production serving, observability, and on-prem deployments. You will work on deployment pipelines, resource scheduling, data and model pipelines, and monitoring within customer environments.

The role involves deploying models with vLLM, Triton, and Kubernetes, maintaining model versions, and optimizing latency and costs.

Qualifications

  • 5+ years in MLOps or ML platform engineering.
  • Experience with model serving and GPU scheduling.
  • Ability to monitor on-prem production workloads.
  • Experience with data/training/evaluation pipelines and versioning.

Responsibilities

  • Deploy and serve models on GPU infrastructure using vLLM, Triton, and Kubernetes.
  • Support data, training, and evaluation pipelines including model versions.
  • Monitor latency, operating cost, and model quality in on-premise deployments.
  • Help deliver private LLM and retrieval-augmented generation platforms for enterprises.

Skills

MLOps
Model serving
GPU scheduling
Data pipelines
Model versioning
On-prem monitoring
English proficiency
Korean language

Job description

Eurosoft is seeking an experienced engineer to build and operate ML systems on customer GPU clusters, ensuring reliable production serving, observability, and on-prem deployments. You will work on deployment pipelines, resource scheduling, data and model pipelines, and monitoring within customer environments.

The role involves deploying models with vLLM, Triton, and Kubernetes, maintaining model versions, and optimizing latency and costs.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior MLOps Engineer: GPU ML Platform & Deployment
Senior MLOps Engineer: GPU ML Platform & Deployment

Eurosoft • United States

Remote
USD 180,000 - 240,000
Remote MLOps Engineer – GPUs, Kubernetes & CI/CD
Remote MLOps Engineer – GPUs, Kubernetes & CI/CD

Eurosoft • United States

Remote
USD 120,000 - 190,000
Remote-first
Option to hybrid from a Tashkent офис
USD compensation
+1
Remote-first MLOps Engineer: GPU-Powered Model Deployment
Remote-first MLOps Engineer: GPU-Powered Model Deployment

Eurosoft • United States

Hybrid
USD 120,000 - 180,000
Remote-first
Hybrid office in Tashkent
Private LLM projects
+1
Remote MLOps Engineer: GPU, vLLM & Kubernetes
Remote MLOps Engineer: GPU, vLLM & Kubernetes

Eurosoft • United States

Remote
USD 140,000 - 190,000
Remote-first
Hybrid option in Tashkent
USD salary
Senior MLOps muhandis
Senior MLOps muhandis

Eurosoft • United States

Remote
USD 140,000 - 190,000
Direct access to executive leadership
Market-level compensation based on经验
Senior MLOps Engineer
Senior MLOps Engineer

Eurosoft • United States

Remote
USD 180,000 - 240,000
Senior ML Platform Engineer: GPU Hosting & MLOps
Senior ML Platform Engineer: GPU Hosting & MLOps

HP • Houston (TX)

On-site
USD 147,000 - 231,000
Health insurance
Dental insurance
Vision insurance
+1
MLOps-инженер (On-Prem, GPU) для частных LLM
MLOps-инженер (On-Prem, GPU) для частных LLM

Eurosoft • United States

Remote
USD 90,000 - 150,000
Competitive salary
Small team, direct interaction with领导
ML Ops Engineer: Deploy, Monitor & Scale Production ML
ML Ops Engineer: Deploy, Monitor & Scale Production ML

Altudo Consultancy Services • United States

Remote
USD 120,000 - 170,000
Senior MLOps Engineer - GPU & OpenShift Infra
Senior MLOps Engineer - GPU & OpenShift Infra

MSH • Charlotte (NC)

On-site
USD 83,000 - 152,000