AI Optimization Engineer

Ethereum Technologies LLC

Jersey City (NJ)

On-site

USD 96,000 - 152,000

Full time

22 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Ethereum Technologies in Jersey City, NJ, seeks an AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML workloads in GPU-accelerated HPC environments. You will drive model training/inference performance, manage scalable AI infrastructure, and deliver production-ready AI solutions.

The role emphasizes hands-on Python, ML/DL, LLMs, and expertise with SLURM, Triton Inference Server, TensorRT-LLM, and containerized microservices.

Qualifications

  • 12+ years of IT/AI engineering experience.
  • Strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.

Responsibilities

  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale Large Language Models (LLMs) in enterprise production environments.
  • Implement model optimization techniques including pruning, quantization, and knowledge distillation.
  • Develop automated workload scheduling and orchestration using SLURM, REST APIs, and Flask.
  • Optimize model inference pipelines using NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Build and deploy containerized ML applications and microservices.
  • Monitor and troubleshoot infrastructure and model performance using Prometheus and Grafana.
  • Perform exploratory data analysis, model evaluation, and performance benchmarking.
  • Collaborate with AI/ML, infrastructure, and DevOps teams to improve scalability, reliability, and resource utilization.

Skills

Python programming
ML & DL
LLMs & Generative AI
SLURM workload management
GPU HPC infrastructure
Model optimization techniques
REST APIs & Flask
Prometheus & Grafana
Data analysis & visualization

Tools

Docker
Kubernetes
Prometheus
Grafana
Flask
MLflow
Terraform
Jenkins
GitHub
Hugging Face

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: AI Optimization Engineer
Location : Jersey City, NJ
Duration: 12 Months + Extension
Bill Rate: $88/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description :

We are seeking an experienced AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML and Generative AI workloads within GPU-accelerated High-Performance Computing (HPC) environments.

The ideal candidate will have strong hands-on experience with Python, Machine Learning, Large Language Models (LLMs), GPU clusters, SLURM workload orchestration, NVIDIA Triton Inference Server, and TensorRT-LLM (TRTLLM). This role involves optimizing model training and inference performance, managing scalable AI infrastructure, and deploying production-ready AI solutions.

Key Responsibilities :
  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale Large Language Models (LLMs) in enterprise production environments.
  • Implement model optimization techniques, including pruning, quantization, and knowledge distillation.
  • Develop automated workload scheduling and orchestration using SLURM, REST APIs, and Flask.
  • Optimize model inference pipelines using NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Build and deploy containerized ML applications and microservices.
  • Monitor and troubleshoot infrastructure and model performance using Prometheus and Grafana.
  • Perform exploratory data analysis, model evaluation, and performance benchmarking.
  • Collaborate with AI/ML, infrastructure, and DevOps teams to improve scalability, reliability, and resource utilization.
Required Technical Skills
1. AI/ML & Generative AI :
  • Strong Python programming experience.
  • Machine Learning and Deep Learning using NumPy, Scikit-learn, TensorFlow, PyTorch, and Keras.
  • Hands-on experience with LLMs, Generative AI, Transformers, NLP, CNNs, and Neural Networks.
  • Knowledge of supervised and unsupervised learning techniques.
  • Hands-on experience with GPU clusters and HPC infrastructure.
  • Strong experience with SLURM workload management and job scheduling.
  • Experience with NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Expertise in model optimization techniques: pruning, quantization, and knowledge distillation.
  • Experience optimizing large-scale model training and inference workloads.
3. DevOps, Containerization & Automation :
  • Docker, Kubernetes, Podman, and containerized microservices.
  • Experience with Enroot and Pyxis container runtimes.
  • MLflow, Terraform, Jenkins, GitHub, and Hugging Face.
  • Flask API development and REST API integration.
  • Prometheus and Grafana for infrastructure and application monitoring.
  • Experience troubleshooting GPU utilization, system performance, and HPC workloads.
5. Data Analysis & Visualization :
  • Experience with Plotly, Seaborn, and Matplotlib.
  • Model performance evaluation, benchmarking, and exploratory data analysis.
  • Knowledge of vector embeddings and cloud-based AI/ML deployments is a plus.
Preferred Qualifications :
  • Experience deploying enterprise-scale Generative AI and LLM solutions.
  • Knowledge of GPU resource optimization and distributed computing.
  • Experience with cloud platforms and vector embedding technologies.
  • Ability to troubleshoot complex AI infrastructure and inference performance issues.
Important Submission Requirements :
  • 12+ years of overall IT/AI engineering experience.
  • Must have strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Optimization Engineer
AI Optimization Engineer

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Robotics Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Robotic Process Automation LLC • Jersey City (NJ)

On-site
USD 83,000 - 165,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
Senior AI Engineer
Senior AI Engineer

Valiant Technologies LLC • Chicago (IL)

Remote
USD 69,000 - 96,000
Senior AI Engineer
Senior AI Engineer

Ethereum Technologies LLC • Chicago (IL)

Remote
USD 86,000 - 123,000
Senior AI Engineer
Senior AI Engineer

Quantum Technologies LLC • Chicago (IL)

Remote
USD 96,000 - 124,000
Senior AI Engineer
Senior AI Engineer

Robotic Process Automation LLC • Chicago (IL)

Remote
USD 83,000 - 131,000