GPU AI Optimization Engineer for HPC & LLMs

Quantum Technologies LLC

Jersey City (NJ)

On-site

USD 100,000 - 142,000

Full time

21 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Quantum Technologies LLC in Jersey City, NJ seeks an experienced AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML workloads within GPU-accelerated HPC environments. You will harness Python, LLMs, and NVIDIA Triton to optimize training and inference at scale.

Responsibilities include deploying LLMs in production, implementing model optimization techniques, and building containerized ML apps with SLURM-based orchestration and monitoring via Prometheus/Grafana.

Qualifications

  • 12+ years of overall IT/AI engineering experience.
  • Strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.
  • Experience with GPU-accelerated HPC environments and containerized ML apps.

Responsibilities

  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale Large Language Models in production.
  • Implement model optimization: pruning, quantization, knowledge distillation.
  • Develop workload scheduling/orchestration using SLURM, REST APIs, and Flask.
  • Optimize inference pipelines with NVIDIA Triton and TRTLLM.

Skills

Python
Machine Learning
LLMs
GPU HPC
SLURM
NVIDIA Triton
TensorRT-LLM
Model optimization

Tools

Docker
Kubernetes
Flask
Prometheus
Grafana
Hugging Face
MLflow
Terraform

Job description

Quantum Technologies LLC in Jersey City, NJ seeks an experienced AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML workloads within GPU-accelerated HPC environments. You will harness Python, LLMs, and NVIDIA Triton to optimize training and inference at scale.

Responsibilities include deploying LLMs in production, implementing model optimization techniques, and building containerized ML apps with SLURM-based orchestration and monitoring via Prometheus/Grafana.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Optimization Engineer for GPU HPC & LLM Deployments
AI Optimization Engineer for GPU HPC & LLM Deployments

Ethereum Technologies LLC • Jersey City (NJ)

On-site
USD 96,000 - 152,000
HPC AI Optimization Engineer: GPU & LLMs
HPC AI Optimization Engineer: GPU & LLMs

Robotic Technologies Automation • Jersey City (NJ)

On-site
USD 83,000 - 165,000
AI Optimization Engineer - Hybrid, GPU HPC for LLMs
AI Optimization Engineer - Hybrid, GPU HPC for LLMs

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
Senior AI Optimization Engineer — GPU HPC & LLMs
Senior AI Optimization Engineer — GPU HPC & LLMs

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
Senior AI Optimization Engineer – GPU HPC & LLMs
Senior AI Optimization Engineer – GPU HPC & LLMs

Robotics Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
ZR_3112_JOB
ZR_3112_JOB

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
AI Optimization Engineer | GPU HPC Onsite in Jersey City
AI Optimization Engineer | GPU HPC Onsite in Jersey City

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000