MLOps & LLM Performance Engineer — Remote

Mercor

San Francisco (CA)

Hybrid

GBP 94,000 - 125,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is seeking an experienced MLOps Engineer, LLM Performance, to design and optimize kernel, profiling, and serving work across ML systems and hardware accelerators. You will guide teams to close knowledge gaps and improve AI model performance on high-end ML infrastructure.

The role is a remote contract with a 40-hour week commitment and compensation of $90–$120 per hour. Join a fast-paced team working with cutting-edge AI research platforms.

Qualifications

  • 2+ years hands-on experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering.
  • Experience writing or optimizing custom kernels (Pallas, Triton, CUDA, CUTLASS) and profiling tools (JAX/XLA profiler, Kineto, torch.profiler, Nsight).
  • Production work with JAX and/or PyTorch; depth in compilers, graph work and distributed training is a strong plus.
  • Experience with modern accelerators (TPU, H100, Trainium, MI300) and throughput/latency trade-offs.
  • Strong written communication and ability to explain complex decisions; able to commit to 40 hours/week.

Responsibilities

  • Design tasks across kernels, profiling, debugging, and inference serving; expose failure modes on accelerator code.
  • Guide teams to improve AI model performance on ML systems, compilers, and training infra topics.
  • Evaluate ML system tasks; provide clear, expert-level technical feedback.
  • Develop guidelines and rubrics for kernel optimization, profiler outputs, and serving throughput/latency choices.
  • Collaborate to keep training data consistent and accurate.

Skills

ML systems
ML infrastructure
Model serving
Accelerator performance
CUDA
JAX
PyTorch
Distributed systems
Throughput optimization

Tools

Pallas
Triton
CUDA
CUTLASS
Kineto
Nsight
TensorRT-LLM

Job description

Mercor is seeking an experienced MLOps Engineer, LLM Performance, to design and optimize kernel, profiling, and serving work across ML systems and hardware accelerators. You will guide teams to close knowledge gaps and improve AI model performance on high-end ML infrastructure.

The role is a remote contract with a 40-hour week commitment and compensation of $90–$120 per hour. Join a fast-paced team working with cutting-edge AI research platforms.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Remote MLOps Engineer: LLM Performance & Kernels
Remote MLOps Engineer: LLM Performance & Kernels

Mercor • United States

Remote
USD 124,000 - 165,000
Remote MLOps Engineer for AI Systems (Contract, $90–$120)
Remote MLOps Engineer for AI Systems (Contract, $90–$120)

Mercor • San Francisco (CA)

Hybrid
GBP 93,000 - 124,000
Weekly payment via Stripe
Remote work
MLOps Engineer - AI Systems
MLOps Engineer - AI Systems

Mercor • United States

Remote
USD 124,000 - 165,000
Remote MLOps Engineer: LLM Performance & Serving
Remote MLOps Engineer: LLM Performance & Serving

Parailabs • United States

Remote
USD 180,000 - 240,000
Remote work
Mlops Engineer - Ai Systems
Mlops Engineer - Ai Systems

Mercor • San Francisco (CA)

Hybrid
GBP 93,000 - 124,000
Weekly payment via Stripe
Remote work
Remote LLM Performance MLOps Engineer (Kernels, Serving)
Remote LLM Performance MLOps Engineer (Kernels, Serving)

AuraOne Human Data • United States

Remote
USD 124,000 - 165,000
Remote MLOps Engineer — LLM Performance & Inference
Remote MLOps Engineer — LLM Performance & Inference

Confidential • United States

Remote
USD 180,000 - 240,000
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

AuraOne, Inc. • United States

Remote
USD 124,000 - 165,000
Ml Infrastructure Expert - Fully Remote | Up To $120/Hr
Ml Infrastructure Expert - Fully Remote | Up To $120/Hr

Mercor • San Francisco (CA)

Hybrid
GBP 94,000 - 125,000
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

Parailabs • United States

Remote
USD 180,000 - 240,000
Remote work