High-Performance AI Inference Platform Engineer

DRW Holdings, LLC; Chicago (IL); On-site; USD 200,000 - 250,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401k with employer match

Disability Insurance

Life and AD&D Insurance

Health Savings Account

Flexible Spending Accounts

Job summary

DRW is seeking an AI Inference Platform Engineer to build, operate, and optimize systems that serve large language, vision, multimodal, and embedding models across DRW. You’ll own the serving platform end-to-end, onboarding models, measuring quality and performance across configurations, and scaling workloads for multiple tenants.

This role requires hands-on GPU literacy and deep experience with modern inference runtimes, KV cache architectures, and multi-tenant scheduling, all within a trading

Qualifications

• Hands-on experience serving LLMs on NVIDIA GPUs.
• Strong Linux and systems performance fundamentals.
• Experience with production-grade CI/CD and monitoring.

Responsibilities

• Optimize LLM inference performance across NVIDIA GPUs and runtimes.
• Build end-to-end profiling and observability from kernel to multi-node systems.
• Own day-0 onboarding, runtime selection, sharding, and serving config for new models.
• Maintain performance profiles and conduct regression testing for quality.

Skills

GPU literacy

Linux proficiency

Observability tooling

Production CI/CD

Tools

TensorRT-LLM

vLLM

SGLang

Job description

DRW is seeking an AI Inference Platform Engineer to build, operate, and optimize systems that serve large language, vision, multimodal, and embedding models across DRW. You’ll own the serving platform end-to-end, onboarding models, measuring quality and performance across configurations, and scaling workloads for multiple tenants.

This role requires hands-on GPU literacy and deep experience with modern inference runtimes, KV cache architectures, and multi-tenant scheduling, all within a trading