ZR_3112_JOB

Simple Solutions

Jersey City (NJ)

Hybrid

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Simple Solutions is seeking an AI Optimization Engineer to optimize, deploy, and manage ML/LLMs on GPU-accelerated HPC infrastructure. The role emphasizes Python-based ML, DL frameworks, and scalable AI systems, working with AI, infra, and DevOps teams to design efficient training and inference pipelines.

Responsibilities include SLURM-based workload orchestration, containerized ML solutions, model optimization (pruning, quantization, distillation), and monitoring with Prometheus and Grafana.

Qualifications

  • Experience with Python-based ML/DL frameworks (NumPy, scikit-learn, TensorFlow, PyTorch, Keras).
  • Hands-on with HPC, GPU clusters, SLURM, Triton Inference Server, TRTLLM, and model optimization (pruning, quantization, distillation).
  • Familiarity with containerization and DevOps tools (Docker, Kubernetes, Jenkins, GitHub).
  • Monitoring/visualization with Prometheus and Grafana; Flask API development; Linux admin (RHEL/CentOS).

Responsibilities

  • Design and optimize AI/ML workloads on GPU-based HPC clusters.
  • Deploy and manage LLMs in scalable production environments.
  • Implement model optimization techniques: pruning, quantization, distillation.
  • Develop and manage automated job scheduling using SLURM with REST and Flask APIs.
  • Monitor system performance with Prometheus and Grafana.
  • Optimize inference pipelines using Triton Inference Server and TRTLLM.
  • Conduct exploratory data analysis and model performance evaluation.
  • Collaborate with infra and ML teams to improve scalability and efficiency.

Skills

Python
Machine Learning
Deep Learning
NumPy
TensorFlow
PyTorch
Keras
SLURM
Triton Inference Server
Prometheus
Grafana
Docker
Kubernetes
MLFlow
Terraform
Jenkins
GitHub
HuggingFace

Tools

Docker
Kubernetes
MLFlow
Terraform
Jenkins
GitHub
HuggingFace

Job description

Job Description Summary – AI Optimization Engineer (Hybrid Onsite 3 days, Jersey City, NJ)

We are seeking an experienced AI Optimization Engineer to support large-scale AI/ML and Generative AI workloads for an enterprise environment. This role focuses on optimizing, deploying, and managing machine learning and large language models (LLMs) on GPU-accelerated HPC infrastructure. The ideal candidate will have strong experience in Python-based machine learning, deep learning frameworks, model optimization techniques, and scalable AI infrastructure.

The engineer will work closely with AI, infrastructure, and DevOps teams to design efficient model training and inference pipelines, implement SLURM-based workload orchestration, and deploy containerized ML solutions in production environments. Responsibilities include optimizing model performance using techniques such as pruning, quantization, and knowledge distillation, managing inference workflows using Triton Inference Server, and monitoring system performance using Prometheus and Grafana.

This role requires hands‑on experience with HPC environments, GPU clusters, containerization technologies, and Linux system administration, along with strong knowledge of machine learning algorithms, deep learning architectures, and modern AI development tools. Experience with cloud platforms, vector embedding, and enterprise‑scale AI deployments is highly preferred.

Core Responsibilities

Design and optimize AI/ML workloads on GPU-based HPC clusters.

Deploy and manage large language models (LLMs) in scalable production environments.

Implement model optimization techniques including pruning, quantization, and knowledge distillation.

Develop and manage automated job scheduling using SLURM with REST and Flask APIs.

Monitor system performance using Prometheus and Grafana.

Optimize inference pipelines using Triton Inference Server and TRTLLM.

Conduct exploratory data analysis and model performance evaluation.

Collaborate with infrastructure and ML teams to improve scalability and efficiency.

Skills Required

The AI Optimization Engineer must have strong experience in Python-based machine learning and deep learning, including NumPy, scikit-learn, TensorFlow, PyTorch, and Keras, with hands‑on knowledge of supervised and unsupervised learning, neural networks, transformer‑based models, NLP, CNNs, and Generative AI concepts. The role requires expertise in AI infrastructure and optimization, including HPC environments, GPU clusters, SLURM workload management, Triton Inference Server, TRTLLM, and model optimization techniques such as pruning, quantization, and distillation for scalable LLM deployment.

Candidates should also have experience with DevOps and deployment tools such as Docker, Kubernetes, MLFlow, Terraform, Jenkins, GitHub, and HuggingFace, along with strong skills in performance monitoring using Prometheus and Grafana. Additional requirements include Flask API development, Linux administration (RHEL/CentOS), container runtimes like Enroot, Pyxis, and Podman, and experience with data analysis and visualization tools such as Plotly, Seaborn, and Matplotlib.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)
AI Optimization Engineer: GPU-HPC & LLMs (Hybrid)

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
AI Optimization Engineer - Hybrid, GPU HPC for LLMs
AI Optimization Engineer - Hybrid, GPU HPC for LLMs

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
AI Optimization Engineer | GPU HPC Onsite in Jersey City
AI Optimization Engineer | GPU HPC Onsite in Jersey City

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
AI/ML Engineer – (Next-Generation AI Platforms & Workloads)
AI/ML Engineer – (Next-Generation AI Platforms & Workloads)

Veear Projects Inc. • Sunnyvale (CA)

On-site
USD 140,000 - 210,000
On-Premise LLM Inference & GPU Systems Engineer
On-Premise LLM Inference & GPU Systems Engineer

Compunnel Inc. • Charlotte (NC)

On-site
USD 120,000 - 150,000
AI Kernel / Cluster Engineer
AI Kernel / Cluster Engineer

Blue Signal Search • Santa Clara (CA)

On-site
USD 150,000 - 210,000
MLOps Engineer
MLOps Engineer

Blue Signal Search • Santa Clara (CA)

On-site
USD 140,000 - 190,000
Advanced GPU infra exposure
Collaborative engineering culture
Open source AI frameworks access
+2
AI/ML Engineer
AI/ML Engineer

Spectraforce Technologies, Inc. • Newark (NJ)

Hybrid
USD 140,000 - 190,000