Senior LLMOps Platform Engineer — GPU AI Infra

Quantum Technologies. LLC

Jersey City (NJ)

Hybrid

USD 120,000 - 165,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

QUANTUM TECHNOLOGIES LLC in the United States seeks an AI Operations Platform Consultant to deploy, operate, and troubleshoot containerized AI services at scale on Kubernetes (OpenShift). You will configure LLM inference pipelines using TensorRT-LLM and Triton Inference Server, implement robust deployment workflows, and build observability for GPU health and performance.

This role requires enterprise experience with MLOps/LLMOps, incident management, and scalable infrastructure, ensuring

Qualifications

  • Experience deploying and operating containerized AI services at scale.
  • Hands-on with TensorRT-LLM and Triton Inference Server in production.
  • Strong knowledge of MLOps/LLMOps pipelines and model versioning.
  • Experience with monitoring GPU health, latency, and throughput.
  • Security-conscious runtime controls and reliability focus.

Responsibilities

  • Deploy and manage production-grade LLM inference services on Kubernetes (OpenShift).
  • Tune and optimize models with mixed precision, quantization, and batching.
  • Design and implement observability dashboards and alerts for inference systems.
  • Ensure reliability, incident management, and scalable infrastructure.

Skills

GPU-accelerated AI platforms
Kubernetes
LLM inference
MLOps/LLMOps
Observability and telemetry
Containerized microservices

Tools

TensorRT-LLM
Triton Inference Server
OpenShift
Container orchestration

Job description

QUANTUM TECHNOLOGIES LLC in the United States seeks an AI Operations Platform Consultant to deploy, operate, and troubleshoot containerized AI services at scale on Kubernetes (OpenShift). You will configure LLM inference pipelines using TensorRT-LLM and Triton Inference Server, implement robust deployment workflows, and build observability for GPU health and performance.

This role requires enterprise experience with MLOps/LLMOps, incident management, and scalable infrastructure, ensuring

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior LLMOps Platform Engineer on Kubernetes
Senior LLMOps Platform Engineer on Kubernetes

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 120,000 - 190,000
AI Operations Platform Consultant
AI Operations Platform Consultant

Quantum Technologies. LLC • Jersey City (NJ)

Hybrid
USD 120,000 - 165,000
Senior LLMOps Platform Engineer (GPU/Kubernetes)
Senior LLMOps Platform Engineer (GPU/Kubernetes)

Robotic Technologies Automation • Jersey City (NJ)

On-site
USD 140,000 - 200,000
Senior AI/ML Platform Engineer – MLOps, Cloud & GitOps Lead
Senior AI/ML Platform Engineer – MLOps, Cloud & GitOps Lead

Quantum Technologies. LLC • Linthicum (MD)

On-site
USD 170,000 - 250,000
Remote AI Infrastructure Engineer (GPU & MLOps)
Remote AI Infrastructure Engineer (GPU & MLOps)

EdgeQ Technologies Private Limited • United States

Remote
USD 95,000 - 155,000
AI Operations Platform Consultant
AI Operations Platform Consultant

Robotic Technologies Automation • Jersey City (NJ)

On-site
USD 140,000 - 200,000
AI Operations Platform Consultant
AI Operations Platform Consultant

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 120,000 - 190,000
AI Platform Engineer: GPU Infra & MLOps
AI Platform Engineer: GPU Infra & MLOps

ICE Clear Europe Limited • Georgia

Hybrid
USD 140,000 - 200,000
Senior AI Platform Engineer | LLM, Cloud, Kubernetes
Senior AI Platform Engineer | LLM, Cloud, Kubernetes

Quantum Technologies LLC • Atlanta (GA)

On-site
USD 78,000 - 112,000
AI Platform Engineer — GPU & Vector AI Infra
AI Platform Engineer — GPU & Vector AI Infra

ICE • Jacksonville (FL)

On-site
USD 120,000 - 180,000