Senior AI Benchmark Engineer - GPU Systems & Inference

IMR Soft Llc; Plano (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

IMR Soft Llc in Plano, TX is seeking an AI Senior Engineer to build and validate GPU infrastructure for distributed training and production inference. You will own the validation suite, optimize benchmarks, and deliver reports that help customers verify performance against reference architecture.

The role requires 5+ years of ML engineering with production GPU workloads, hands-on multi-node distributed training, and expertise in PyTorch DDP/FSDP, DeepSpeed, Triton, and vLLM.

Qualifications

• 5+ years ML engineering, MLOps, or performance engineering with production GPU workloads.
• Hands-on distributed training on multi-node GPU clusters not single-GPU or notebook-scale work.
• Production LLM inference serving: Triton, vLLM, or TensorRT-LLM.
• Rigorous benchmarking discipline you can profile a system, explain where GPU time actually goes, and defend a number.
• Strong Python; containers and Kubernetes-native workflows (Kubeflow, Ray, Argo Workflows).
• Clear technical writing. A validation report is a deliverable a customer pays for.

Responsibilities

• Enable and tune distributed training on multi-node GPU clusters.
• Architect inference serving with Triton, NVIDIA NIM, vLLM, TensorRT-LLM.
• Size inference platforms by customer SLOs: latency, throughput, concurrency.
• Support GenAI patterns: RAG, fine-tuning, agentic pipelines.
• Build and own GPU infrastructure validation suite: NCCL scaling, MFU baselines.
• Deliver acceptance validation engagements with signed reports for customers.
• Design the continuous-validation service: post-downtime revalidation, driver/firmware certification.
• Produce published benchmark methodology and reports to establish credibility.
• Own PoC workload design and benchmark evidence to close engagements.

Skills

Distributed training

PyTorch DDP/FSDP

DeepSpeed/ZeRO

NCCL tuning

Python

Kubernetes

Kubeflow

vLLM

Triton

TensorRT-LLM

Benchmarking

Technical writing

Job description

IMR Soft Llc in Plano, TX is seeking an AI Senior Engineer to build and validate GPU infrastructure for distributed training and production inference. You will own the validation suite, optimize benchmarks, and deliver reports that help customers verify performance against reference architecture.

The role requires 5+ years of ML engineering with production GPU workloads, hands-on multi-node distributed training, and expertise in PyTorch DDP/FSDP, DeepSpeed, Triton, and vLLM.