AI Optimization Engineer for GPU HPC & LLM Deployments

Ethereum Technologies LLC

Jersey City (NJ)

On-site

USD 96,000 - 152,000

Full time

22 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Ethereum Technologies in Jersey City, NJ, seeks an AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML workloads in GPU-accelerated HPC environments. You will drive model training/inference performance, manage scalable AI infrastructure, and deliver production-ready AI solutions.

The role emphasizes hands-on Python, ML/DL, LLMs, and expertise with SLURM, Triton Inference Server, TensorRT-LLM, and containerized microservices.

Qualifications

  • 12+ years of IT/AI engineering experience.
  • Strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.

Responsibilities

  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale Large Language Models (LLMs) in enterprise production environments.
  • Implement model optimization techniques including pruning, quantization, and knowledge distillation.
  • Develop automated workload scheduling and orchestration using SLURM, REST APIs, and Flask.
  • Optimize model inference pipelines using NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Build and deploy containerized ML applications and microservices.
  • Monitor and troubleshoot infrastructure and model performance using Prometheus and Grafana.
  • Perform exploratory data analysis, model evaluation, and performance benchmarking.
  • Collaborate with AI/ML, infrastructure, and DevOps teams to improve scalability, reliability, and resource utilization.

Skills

Python programming
ML & DL
LLMs & Generative AI
SLURM workload management
GPU HPC infrastructure
Model optimization techniques
REST APIs & Flask
Prometheus & Grafana
Data analysis & visualization

Tools

Docker
Kubernetes
Prometheus
Grafana
Flask
MLflow
Terraform
Jenkins
GitHub
Hugging Face

Job description

Ethereum Technologies in Jersey City, NJ, seeks an AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML workloads in GPU-accelerated HPC environments. You will drive model training/inference performance, manage scalable AI infrastructure, and deliver production-ready AI solutions.

The role emphasizes hands-on Python, ML/DL, LLMs, and expertise with SLURM, Triton Inference Server, TensorRT-LLM, and containerized microservices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Optimization Engineer - Hybrid, GPU HPC for LLMs
AI Optimization Engineer - Hybrid, GPU HPC for LLMs

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
HPC AI Optimization Engineer: GPU & LLMs
HPC AI Optimization Engineer: GPU & LLMs

Robotic Process Automation LLC • Jersey City (NJ)

On-site
USD 83,000 - 165,000
GPU AI Optimization Engineer for HPC & LLMs
GPU AI Optimization Engineer for HPC & LLMs

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
Senior AI Optimization Engineer – GPU HPC & LLMs
Senior AI Optimization Engineer – GPU HPC & LLMs

Robotics Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
Senior AI Optimization Engineer — GPU HPC & LLMs
Senior AI Optimization Engineer — GPU HPC & LLMs

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer | GPU HPC Onsite in Jersey City
AI Optimization Engineer | GPU HPC Onsite in Jersey City

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
ZR_3112_JOB
ZR_3112_JOB

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000