AI Optimization Engineer

Robotics Technologies LLC

Jersey City (NJ)

On-site

USD 100,000 - 142,000

Full time

11 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Robotics Technologies LLC in Jersey City, NJ seeks an AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML workloads in GPU-accelerated HPC environments. You will build scalable AI infrastructure, deploy production-ready AI solutions, and collaborate with cross-functional teams.

The role emphasizes hands-on Python, ML/DL, LLMs, SLURM, Triton, TRTLLM, and containerized microservices. Expect a 12-month+ engagement with a bill rate of $88/hour on a W-2/1099/C2C basis.

Qualifications

  • Strong Python programming experience.
  • Machine Learning and Deep Learning with common frameworks.
  • Hands-on experience with LLMs and Generative AI.
  • Experience with GPU clusters and HPC infrastructure.
  • Strong SLURM workload management and scheduling.
  • Experience with NVIDIA Triton Inference Server and TRT-LLM.
  • Model optimization: pruning, quantization, distillation.
  • Experience optimizing large-scale model training and inference workloads.

Responsibilities

  • Design, deploy, and optimize AI/ML workloads across GPU HPC clusters.
  • Deploy, manage, and scale LLMs in enterprise environments.
  • Implement model optimization techniques (pruning, quantization, distillation).
  • Develop automated workload scheduling using SLURM, REST APIs, Flask.
  • Optimize inference with Triton Inference Server and TRT-LLM.
  • Build and deploy containerized ML apps and microservices.
  • Monitor performance with Prometheus and Grafana.
  • Perform benchmarking and data analysis for models.
  • Collaborate with AI/ML, infra and DevOps teams to improve scalability.

Skills

Python
ML & DL
LLMs
GPU HPC
SLURM
Model optimization

Tools

Docker
Kubernetes
Flask
REST API
Prometheus
Grafana
MLflow
Terraform
Jenkins
GitHub
Hugging Face
TensorRT-LLM
Enroot/Pyxis

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Job Title: AI Optimization Engineer
Location : Jersey City, NJ
Duration: 12 Months + Extension
Bill Rate: $88/hour
Job Type: W-2, 1099, C2C
Client: To Be Discussed Later
Work Authorization: US-Citizen, H-1B, OPT-EAD, GC-EAD

Job Description :

We are seeking an experienced AI Optimization Engineer to design, optimize, and deploy large-scale AI/ML and Generative AI workloads within GPU-accelerated High-Performance Computing (HPC) environments.

The ideal candidate will have strong hands-on experience with Python, Machine Learning, Large Language Models (LLMs), GPU clusters, SLURM workload orchestration, NVIDIA Triton Inference Server, and TensorRT-LLM (TRTLLM). This role involves optimizing model training and inference performance, managing scalable AI infrastructure, and deploying production-ready AI solutions.

Key Responsibilities :
  • Design, deploy, and optimize AI/ML workloads across GPU-based HPC clusters.
  • Deploy, manage, and scale Large Language Models (LLMs) in enterprise production environments.
  • Implement model optimization techniques, including pruning, quantization, and knowledge distillation.
  • Develop automated workload scheduling and orchestration using SLURM, REST APIs, and Flask.
  • Optimize model inference pipelines using NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Build and deploy containerized ML applications and microservices.
  • Monitor and troubleshoot infrastructure and model performance using Prometheus and Grafana.
  • Perform exploratory data analysis, model evaluation, and performance benchmarking.
  • Collaborate with AI/ML, infrastructure, and DevOps teams to improve scalability, reliability, and resource utilization.
Required Technical Skills
1. AI/ML & Generative AI :
  • Strong Python programming experience.
  • Machine Learning and Deep Learning using NumPy, Scikit-learn, TensorFlow, PyTorch, and Keras.
  • Hands-on experience with LLMs, Generative AI, Transformers, NLP, CNNs, and Neural Networks.
  • Knowledge of supervised and unsupervised learning techniques.
  • Hands-on experience with GPU clusters and HPC infrastructure.
  • Strong experience with SLURM workload management and job scheduling.
  • Experience with NVIDIA Triton Inference Server and TensorRT-LLM (TRTLLM).
  • Expertise in model optimization techniques: pruning, quantization, and knowledge distillation.
  • Experience optimizing large-scale model training and inference workloads.
3. DevOps, Containerization & Automation :
  • Docker, Kubernetes, Podman, and containerized microservices.
  • Experience with Enroot and Pyxis container runtimes.
  • MLflow, Terraform, Jenkins, GitHub, and Hugging Face.
  • Flask API development and REST API integration.
  • Prometheus and Grafana for infrastructure and application monitoring.
  • Experience troubleshooting GPU utilization, system performance, and HPC workloads.
5. Data Analysis & Visualization :
  • Experience with Plotly, Seaborn, and Matplotlib.
  • Model performance evaluation, benchmarking, and exploratory data analysis.
  • Knowledge of vector embeddings and cloud-based AI/ML deployments is a plus.
Preferred Qualifications :
  • Experience deploying enterprise-scale Generative AI and LLM solutions.
  • Knowledge of GPU resource optimization and distributed computing.
  • Experience with cloud platforms and vector embedding technologies.
  • Ability to troubleshoot complex AI infrastructure and inference performance issues.
Important Submission Requirements :
  • 12+ years of overall IT/AI engineering experience.
  • Must have strong hands-on experience with Python, AI/ML, LLMs, SLURM, Triton Inference Server, TRTLLM, GPU clusters, and HPC infrastructure.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Optimization Engineer
AI Optimization Engineer

Robotic Process Automation LLC • Jersey City (NJ)

On-site
USD 83,000 - 165,000
AI Optimization Engineer
AI Optimization Engineer

Quantum Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Valiant Technologies LLC • Jersey City (NJ)

On-site
USD 100,000 - 142,000
AI Optimization Engineer
AI Optimization Engineer

Ethereum Technologies LLC • Jersey City (NJ)

On-site
USD 96,000 - 152,000
AI Optimization Engineer - Hybrid Onsite 3 days
AI Optimization Engineer - Hybrid Onsite 3 days

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 180,000
ZR_3112_JOB
ZR_3112_JOB

Simple Solutions • Jersey City (NJ)

Hybrid
USD 120,000 - 160,000
ZR_2880_JOB
ZR_2880_JOB

Simple Solutions • Jersey City (NJ)

On-site
USD 150,000 - 190,000
Senior AI Engineer
Senior AI Engineer

Robotics Technologies LLC • Chicago (IL)

Remote
USD 86,000 - 123,000
Senior AI Engineer
Senior AI Engineer

Valiant Technologies LLC • Chicago (IL)

Remote
USD 69,000 - 96,000
Senior AI Engineer
Senior AI Engineer

Ethereum Technologies LLC • Chicago (IL)

Remote
USD 86,000 - 123,000