AI Optimization Engineer

Robotic Process Automation LLC

Jersey City (NJ)

On-site

USD 83,000 - 165,000

Full time

19 hours ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Robotic Technologies Automation in Jersey City, NJ is seeking an experienced AI Optimization Engineer to design and deploy large-scale AI/ML workloads in GPU-accelerated HPC environments.

You will optimize training and inference, deploy enterprise-grade LLMs, and implement model optimization techniques. Strong Python, SLURM, Triton, TRTLLM, and containerized microservices experience are required.

Qualifications

  • 12+ years of overall IT/AI engineering experience.
  • Must have strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.

Responsibilities

  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale Large Language Models (LLMs) in enterprise production environments.
  • Implement model optimization techniques, including pruning, quantization, and knowledge distillation.
  • Develop automated workload scheduling and orchestration using SLURM, REST APIs, and Flask.
  • Optimize model inference pipelines using NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Build and deploy containerized ML applications and microservices.
  • Monitor and troubleshoot infrastructure and model performance using Prometheus and Grafana.
  • Perform exploratory data analysis, model evaluation, and performance benchmarking.
  • Collaborate with AI/ML, infrastructure, and DevOps teams to improve scalability, reliability, and resource utilization.

Skills

Python
Machine Learning
Deep Learning
LLMs / Generative AI
GPU HPC
SLURM
NVIDIA Triton
TensorRT-LLM
Model optimization
REST API / Flask
Docker / Kubernetes
Prometheus & Grafana
Data analysis & visualization

Tools

Docker
Kubernetes
Podman
Enroot
Pyxis
MLflow
Terraform
Jenkins
GitHub
Hugging Face
Flask
Prometheus
Grafana

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: AI Optimization Engineer
Location : Jersey City, NJ
Duration: 12 Months + Extension
Bill Rate: $88/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description :

We are seeking an experienced AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML and Generative AI workloads within GPU-accelerated High-Performance Computing (HPC) environments.

The ideal candidate will have strong hands-on experience with Python, Machine Learning, Large Language Models (LLMs), GPU clusters, SLURM workload orchestration, NVIDIA Triton Inference Server, and TensorRT-LLM (TRTLLM). This role involves optimizing model training and inference performance, managing scalable AI infrastructure, and deploying production-ready AI solutions.

Key Responsibilities :
  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale Large Language Models (LLMs) in enterprise production environments.
  • Implement model optimization techniques, including pruning, quantization, and knowledge distillation.
  • Develop automated workload scheduling and orchestration using SLURM, REST APIs, and Flask.
  • Optimize model inference pipelines using NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Build and deploy containerized ML applications and microservices.
  • Monitor and troubleshoot infrastructure and model performance using Prometheus and Grafana.
  • Perform exploratory data analysis, model evaluation, and performance benchmarking.
  • Collaborate with AI/ML, infrastructure, and DevOps teams to improve scalability, reliability, and resource utilization.
Required Technical Skills
1. AI/ML & Generative AI :
  • Strong Python programming experience.
  • Machine Learning and Deep Learning using NumPy, Scikit-learn, TensorFlow, PyTorch, and Keras.
  • Hands-on experience with LLMs, Generative AI, Transformers, NLP, CNNs, and Neural Networks.
  • Knowledge of supervised and unsupervised learning techniques.
  • Hands-on experience with GPU clusters and HPC infrastructure.
  • Strong experience with SLURM workload management and job scheduling.
  • Experience with NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Expertise in model optimization techniques: pruning, quantization, and knowledge distillation.
  • Experience optimizing large-scale model training and inference workloads.
3. DevOps, Containerization & Automation :
  • Docker, Kubernetes, Podman, and containerized microservices.
  • Experience with Enroot and Pyxis container runtimes.
  • MLflow, Terraform, Jenkins, GitHub, and Hugging Face.
  • Flask API development and REST API integration.
  • Prometheus and Grafana for infrastructure and application monitoring.
  • Experience troubleshooting GPU utilization, system performance, and HPC workloads.
5. Data Analysis & Visualization :
  • Experience with Plotly, Seaborn, and Matplotlib.
  • Model performance evaluation, benchmarking, and exploratory data analysis.
  • Knowledge of vector embeddings and cloud-based AI/ML deployments is a plus.
Preferred Qualifications :
  • Experience deploying enterprise-scale Generative AI and LLM solutions.
  • Knowledge of GPU resource optimization and distributed computing.
  • Experience with cloud platforms and vector embedding technologies.
  • Ability to troubleshoot complex AI infrastructure and inference performance issues.
Important Submission Requirements :
  • 12+ years of overall IT/AI engineering experience.
  • Must have strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Optimization Engineer
AI Optimization Engineer

Robotics Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Ethereum Technologies LLC • Jersey City (NJ)

On-site
USD 96,000 - 152,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
ZR_3112_JOB
ZR_3112_JOB

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
Senior AI Engineer
Senior AI Engineer

Robotics Technologies LLC • Chicago (IL)

Remote
USD 86,000 - 123,000
Senior AI Engineer
Senior AI Engineer

Valiant Technologies LLC • Chicago (IL)

Remote
USD 69,000 - 96,000
Senior AI Engineer
Senior AI Engineer

Robotic Process Automation LLC • Chicago (IL)

Remote
USD 83,000 - 131,000