Senior MLOps Engineer - GPU & OpenShift Infra

MSH

Charlotte (NC)

On-site

USD 83,000 - 152,000

Part time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

MSH is seeking an experienced MLOps Engineer to lead infrastructure for enterprise-scale Generative AI and Predictive AI platforms in Charlotte, NC. The role emphasizes GPU-accelerated environments, OpenShift, Kubernetes, automation, and observability at scale.

The ideal candidate will bring hands-on experience supporting production AI/ML workloads in regulated enterprise settings, with strong Linux administration, CI/CD, and incident-management skills.

Qualifications

  • 5+ years of infrastructure engineering experience.
  • 5+ years troubleshooting end-to-end architectures, including CI/CD pipelines.
  • 5+ years Linux systems administration and troubleshooting.
  • 4+ years supporting AI/ML platforms.
  • 4+ years Kubernetes/container platforms production operations.
  • Strong experience with automation, production support, and incident management.

Responsibilities

  • Lead infrastructure initiatives supporting Generative AI and Predictive AI platforms from design through production operations.
  • Design, deploy, and manage OpenShift-based container platforms optimized for GPU-accelerated workloads.
  • Support AI/ML model training, inference, and batch processing environments.
  • Build and operate scalable GPU infrastructure, including multi-node GPU clusters and GPU SuperPod architectures.
  • Develop and maintain monitoring, alerting, and observability solutions using Grafana, Splunk, and enterprise telemetry tools.
  • Define and implement SLIs/SLOs to proactively identify performance, capacity, and reliability risks.
  • Develop AI-driven and agent-based automation for self-healing, scaling, diagnostics, and incident remediation.
  • Apply AIOps practices to reduce alert fatigue and improve platform reliability.
  • Lead production incident investigations, root-cause analysis, and preventive remediation initiatives.
  • Collaborate with cross-functional and geographically distributed engineering teams while mentoring other engineers.
  • Ensure platform stability, availability, resiliency, and compliance with enterprise operational controls.

Skills

MLOps
Kubernetes
OpenShift
CI/CD
Linux administration
Incident management

Tools

Grafana
Splunk
Telemetry pipelines

Job description

MSH is seeking an experienced MLOps Engineer to lead infrastructure for enterprise-scale Generative AI and Predictive AI platforms in Charlotte, NC. The role emphasizes GPU-accelerated environments, OpenShift, Kubernetes, automation, and observability at scale.

The ideal candidate will bring hands-on experience supporting production AI/ML workloads in regulated enterprise settings, with strong Linux administration, CI/CD, and incident-management skills.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior MLOps Architect: GPU AI Platforms & OpenShift
Senior MLOps Architect: GPU AI Platforms & OpenShift

Conch Technologies, Inc. • Dallas (TX)

On-site
USD 140,000 - 180,000
ML Ops Engineer
ML Ops Engineer

MSH • Charlotte (NC)

On-site
USD 83,000 - 152,000
AI Infrastructure Engineer: GPU & OpenShift Lead
AI Infrastructure Engineer: GPU & OpenShift Lead

NTT DATA Deutschland • Charlotte (NC)

On-site
USD 83,000 - 90,000
Medical, dental, and vision insurance
401k program
Employee assistance
MLOPS Engineer
MLOPS Engineer

Conch Technologies Inc • Dallas (TX)

On-site
USD 140,000 - 180,000
MLOPS Engineer
MLOPS Engineer

Saransh Inc • Jersey (AR)

On-site
USD 140,000 - 190,000
AI Infra Engineer: GPU, OpenShift & Observability
AI Infra Engineer: GPU, OpenShift & Observability

NTT DATA, Inc. • Charlotte (NC)

On-site
USD 83,000 - 90,000
Medical insurance
Dental insurance
Vision insurance
+5
Senior MLOps Engineer: GPU AI Infra & Production
Senior MLOps Engineer: GPU AI Infra & Production

Blue Signal Search • Santa Clara (CA)

On-site
USD 140,000 - 190,000
Advanced GPU infra exposure
Collaborative engineering culture
Open source AI frameworks access
+2
MLOps Engineer
MLOps Engineer

Blue Signal Search • Santa Clara (CA)

On-site
USD 140,000 - 190,000
Advanced GPU infra exposure
Collaborative engineering culture
Open source AI frameworks access
+2
Senior ML Ops Engineer — AI Infrastructure & Cloud
Senior ML Ops Engineer — AI Infrastructure & Cloud

NVIDIA Corporation • Santa Clara (CA)

On-site
USD 184,000 - 357,000
Equity
Benefits
Senior AI/ML Engineer – GPU & MLOps Lead (Hybrid)
Senior AI/ML Engineer – GPU & MLOps Lead (Hybrid)

Katalyst Data Management • Houston (TX)

Hybrid
USD 120,000 - 150,000