Senior AI Optimization Engineer — GPU HPC & LLMs

Valiant Technologies LLC

Jersey City (NJ)

On-site

USD 100,000 - 142,000

Full time

20 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valiant Technologies LLC is seeking an experienced AI Optimization Engineer to design, optimize, and deploy large‑scale AI/ML workloads in GPU‑accelerated HPC environments in Jersey City, NJ. The role covers model training and inference optimization, scalable AI infra, and production-grade solutions.

The candidate should master Python, LLMs, CUDA‑related toolchains, and containerized microservices, with strong DevOps and data‑driven benchmarking experience. 12+ years expected.

Qualifications

  • 12+ years of IT/AI engineering experience.
  • Hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.
  • Experience with containerization, REST APIs, and monitoring tools.

Responsibilities

  • Design, deploy, and optimize AI/ML workloads across GPU HPC clusters.
  • Deploy, manage, and scale LLMs in enterprise production environments.
  • Implement model optimization techniques (pruning, quantization, distillation).
  • Develop workload scheduling with SLURM, REST APIs, and Flask.
  • Optimize inference using Triton and TRTLLM.
  • Build and deploy containerized ML apps and microservices.
  • Monitor performance with Prometheus and Grafana.
  • Collaborate with AI/ML, infra, and DevOps teams for scalability.

Skills

Python
ML & DL
LLMs
GPU clusters
HPC
SLURM
Triton Server
TensorRT-LLM
Model optimization
Flask API

Tools

Docker
Kubernetes
Enroot
Pyxis
MLflow
Terraform
Jenkins
GitHub
Hugging Face
Prometheus
Grafana

Job description

Valiant Technologies LLC is seeking an experienced AI Optimization Engineer to design, optimize, and deploy large‑scale AI/ML workloads in GPU‑accelerated HPC environments in Jersey City, NJ. The role covers model training and inference optimization, scalable AI infra, and production-grade solutions.

The candidate should master Python, LLMs, CUDA‑related toolchains, and containerized microservices, with strong DevOps and data‑driven benchmarking experience. 12+ years expected.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

HPC AI Optimization Engineer: GPU & LLMs
HPC AI Optimization Engineer: GPU & LLMs

Robotic Process Automation LLC • Jersey City (NJ)

On-site
USD 83,000 - 165,000
AI Optimization Engineer for GPU HPC & LLM Deployments
AI Optimization Engineer for GPU HPC & LLM Deployments

Ethereum Technologies LLC • Jersey City (NJ)

On-site
USD 96,000 - 152,000
GPU AI Optimization Engineer for HPC & LLMs
GPU AI Optimization Engineer for HPC & LLMs

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
Senior AI Optimization Engineer – GPU HPC & LLMs
Senior AI Optimization Engineer – GPU HPC & LLMs

Robotics Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer - Hybrid, GPU HPC for LLMs
AI Optimization Engineer - Hybrid, GPU HPC for LLMs

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
AI Optimization Engineer
AI Optimization Engineer

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Ethereum Technologies LLC • Jersey City (NJ)

On-site
USD 96,000 - 152,000
AI Optimization Engineer
AI Optimization Engineer

Robotic Process Automation LLC • Jersey City (NJ)

On-site
USD 83,000 - 165,000