AI Optimization Engineer - Hybrid, GPU HPC for LLMs

Simple Solutions

Jersey City (NJ)

Hybrid

USD 120,000 - 180,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Simple Solutions in Jersey City, NJ is seeking an experienced AI Optimization Engineer to design and run large-scale AI/ML workloads on GPU‑based HPC clusters. The role focuses on deploying and optimizing models, including LLMs, with attention to performance, scalability, and reliability in production environments.

You will implement pruning, quantization, and distillation, build SLURM‑driven pipelines with REST and Flask APIs, and collaborate with infrastructure and ML teams while using

Qualifications

  • Strong experience with Python for ML/AI workloads.
  • Experience optimizing ML models for inference at scale.
  • Hands-on with SLURM and containerized AI pipelines.
  • Proficient in Linux system administration and HPC concepts.

Responsibilities

  • Design and optimize AI/ML workloads on GPU HPC clusters.
  • Deploy and manage LLMs in production environments.
  • Implement model optimization techniques (pruning, quantization, distillation).
  • Develop SLURM-based job scheduling with REST/Flask APIs.
  • Monitor performance with Prometheus and Grafana.

Skills

Python-based ML
Deep Learning
HPC/GPU clusters
SLURM workload management
Model optimization
Deployment pipelines

Tools

Docker
Kubernetes
MLFlow
Terraform
Jenkins
GitHub
Triton Inference Server
Prometheus
Grafana
Flask API
Enroot
Podman
TRTLLM

Job description

Simple Solutions in Jersey City, NJ is seeking an experienced AI Optimization Engineer to design and run large-scale AI/ML workloads on GPU‑based HPC clusters. The role focuses on deploying and optimizing models, including LLMs, with attention to performance, scalability, and reliability in production environments.

You will implement pruning, quantization, and distillation, build SLURM‑driven pipelines with REST and Flask APIs, and collaborate with infrastructure and ML teams while using

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
AI Optimization Engineer | GPU HPC Onsite in Jersey City
AI Optimization Engineer | GPU HPC Onsite in Jersey City

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
ZR_3112_JOB
ZR_3112_JOB

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
Senior LLMOps Platform Engineer (GPU/Kubernetes)
Senior LLMOps Platform Engineer (GPU/Kubernetes)

Robotic Technologies Automation • Jersey City (NJ)

On-site
USD 140,000 - 200,000
ML Optimization Engineer: Training & Inference on GPUs
ML Optimization Engineer: Training & Inference on GPUs

Generalist • Somerville (NJ)

On-site
USD 150,000 - 210,000
AI/ML Engineer – (Next-Generation AI Platforms & Workloads)
AI/ML Engineer – (Next-Generation AI Platforms & Workloads)

Veear Projects Inc. • Sunnyvale (CA)

On-site
USD 140,000 - 210,000
Hybrid ML Infra Engineer for Scalable LLM Training
Hybrid ML Infra Engineer for Scalable LLM Training

Harnham • United States

Hybrid
USD 180,000 - 240,000
Senior GenAI/ML Engineer - Hybrid (Production-Grade LLMs)
Senior GenAI/ML Engineer - Hybrid (Production-Grade LLMs)

Aegistech • New Jersey

Hybrid
USD 180,000 - 240,000