Remote MLOps Engineer for Scalable LLM Systems

Benture; California, Northern (MO, KY); Hybrid; USD 124,000 - 165,000; Full time

Job summary

Benture is seeking an experienced MLOps Engineer, specializing in LLM systems, to join a frontier AI lab's GenAI team on a full-time basis. You will contribute to building foundational large language models and ML infrastructure, with a focus on performance, scalability, and data generation.

The role requires 2+ years in ML infrastructure, hands-on with JAX and PyTorch, CUDA/Triton, and experience in model serving and KPI-driven optimization.

Qualifications

• 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or GPU/accelerator performance engineering.
• Production experience with JAX and/or PyTorch; framework-level depth (custom operators, FSDP, DDP, DeepSpeed, Megatron) is a strong plus.
• Familiarity with modern accelerators (A100, H100, TPU) and the ability to reason about throughput, latency, and memory trade-offs.
• Practical experience in at least one of: custom GPU kernel development (CUDA, Triton, Pallas); performance profiling and trace analysis; debugging distributed or accelerator-bound workloads; or large-scale LLM serving.

Responsibilities

• Design and solve challenging MLOps tasks across GPU kernels, performance profiling, debugging, and inference serving for high-quality training data.
• Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems and training infrastructure.
• Evaluate MLOps tasks and solutions, providing clear, rigorous written technical feedback.
• Develop rubrics and evaluation frameworks for kernel optimization, profiler output interpretation, and serving throughput/latency trade-offs.
• Collaborate with experts to ensure consistency and accuracy across training datasets.

Skills

MLOps

GPU perf engineering

JAX

PyTorch

Distributed systems

LLM serving

Written communication

Tools

CUDA

Triton

Pallas

Kineto

torch.profiler

Nsight

XLA/JAX profiler

DeepSpeed

Megatron

Ray Serve

TensorRT-LLM

Job description

Benture is seeking an experienced MLOps Engineer, specializing in LLM systems, to join a frontier AI lab's GenAI team on a full-time basis. You will contribute to building foundational large language models and ML infrastructure, with a focus on performance, scalability, and data generation.

The role requires 2+ years in ML infrastructure, hands-on with JAX and PyTorch, CUDA/Triton, and experience in model serving and KPI-driven optimization.