Production AI/ML Engineer - LLM & GPU Ops (Remote)

7Seventy Recruiting; United States; On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Health Insurance

Conference travel budget

Flexible paid time off

Off-site events

Job summary

7Seventy Recruiting is seeking an Applied AI/ML Engineer to own end-to-end AI product delivery, from prototype to production deployment, across reinforcement learning, inference optimization, and GPU infrastructure. You will improve model quality, throughput, latency, and reliability in a remote-first, data-driven environment.

Responsibilities include deploying LLM inference, optimizing batching and caching, and building evaluation and benchmarking frameworks to drive continuous improvement in

Qualifications

• 3+ years designing, deploying, and operating production AI/ML systems.
• Hands-on experience serving large language models with vLLM/SGLang/TensorRT-LLM.
• Experience with distributed training or inference optimization is preferred.

Responsibilities

• Own AI-powered features from prototype to production deployment.
• Deploy and optimize LLM inference using vLLM and SGLang.
• Collaborate with infra and product teams to improve GPU scheduling and throughput.

Skills

Production AI

PyTorch

GPU inference

Kubernetes

Container deployments

Tools

vLLM

SGLang

Megatron-LM

TensorRT-LLM

Job description

7Seventy Recruiting is seeking an Applied AI/ML Engineer to own end-to-end AI product delivery, from prototype to production deployment, across reinforcement learning, inference optimization, and GPU infrastructure. You will improve model quality, throughput, latency, and reliability in a remote-first, data-driven environment.

Responsibilities include deploying LLM inference, optimizing batching and caching, and building evaluation and benchmarking frameworks to drive continuous improvement in