Senior AI Optimization & GPU HPC Engineer

CloudBigD

Jersey City (NJ)

On-site

USD 170,000 - 210,000

Full time

48 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CloudBigD is seeking an experienced AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML workloads in GPU-accelerated HPC environments at Jersey City, NJ. You will optimize training and inference, build scalable AI infrastructure, and deploy production-ready AI solutions.

The ideal candidate has hands-on Python, ML, LLMs, GPU clusters, SLURM, Triton Inference Server, TensorRT-LLM, and experience with containerized microservices, Prometheus and Grafana.

Qualifications

  • 12+ years of overall IT/AI engineering experience.
  • Strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.

Responsibilities

  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale LLMs in enterprise production environments.
  • Implement model optimization techniques: pruning, quantization, distillation.
  • Develop workload scheduling and orchestration using SLURM, REST APIs, and Flask.
  • Optimize inference pipelines with NVIDIA Triton and TensorRT-LLM.
  • Build and deploy containerized ML apps and microservices.
  • Monitor infra and model performance with Prometheus and Grafana.
  • Perform exploratory data analysis, model evaluation, and benchmarking.
  • Collaborate with AI/ML, infrastructure, and DevOps teams to improve scalability and resource utilization.

Skills

Python
ML/DL frameworks
LLMs/Generative AI
GPU HPC
SLURM
Triton Inference
TensorRT-LLM
Model optimization
NLP/NNs
Containerization

Tools

Docker
Kubernetes
Podman
Enroot
Pyxis
MLflow
Terraform
Jenkins
GitHub
Hugging Face
Prometheus
Grafana
Flask

Job description

CloudBigD is seeking an experienced AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML workloads in GPU-accelerated HPC environments at Jersey City, NJ. You will optimize training and inference, build scalable AI infrastructure, and deploy production-ready AI solutions.

The ideal candidate has hands-on Python, ML, LLMs, GPU clusters, SLURM, Triton Inference Server, TensorRT-LLM, and experience with containerized microservices, Prometheus and Grafana.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Optimization Engineer for GPU HPC & LLM Deployments
AI Optimization Engineer for GPU HPC & LLM Deployments

Ethereum Technologies LLC • Jersey City (NJ)

On-site
USD 96,000 - 152,000
HPC AI Optimization Engineer: GPU & LLMs
HPC AI Optimization Engineer: GPU & LLMs

Robotic Process Automation LLC • Jersey City (NJ)

On-site
USD 83,000 - 165,000
GPU AI Optimization Engineer for HPC & LLMs
GPU AI Optimization Engineer for HPC & LLMs

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
Senior AI Optimization Engineer – GPU HPC & LLMs
Senior AI Optimization Engineer – GPU HPC & LLMs

Robotics Technologies • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer - Hybrid, GPU HPC for LLMs
AI Optimization Engineer - Hybrid, GPU HPC for LLMs

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
Senior AI Optimization Engineer — GPU HPC & LLMs
Senior AI Optimization Engineer — GPU HPC & LLMs

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
AI Optimization Engineer | GPU HPC Onsite in Jersey City
AI Optimization Engineer | GPU HPC Onsite in Jersey City

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000