MLOps Engineer - AI Systems

Mercor

United States

Remote

USD 124,000 - 165,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Mercor is seeking an MLOps Engineer focusing on LLM performance, kernels, profiling, and serving. This remote contract role requires 40 hours per week and involves evaluating ML systems, optimizer kernel work, and collaboration with research and engineering teams to improve AI model performance on ML systems and training infrastructure.

The ideal candidate has hands-on ML systems experience, CUDA/TensorRT kernel work, and strong communication skills to clearly explain complex technical decisions

Qualifications

  • 2+ years of hands-on experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering.
  • Proven ability to write or optimize custom kernels (CUDA/TensorRT) and perform performance profiling and trace analysis (JAX/XLA profiler, Kineto, torch.profiler, Nsight).
  • Experience with distributed or accelerator-bound workloads and serving large language models at scale (e.g., vLLM, TensorRT-LLM, KV cache, paged attention).
  • Working production experience with JAX and/or PyTorch.
  • Deep knowledge of modern accelerators (TPU v4-v6e, H100, Trainium, MI300) and ability to reason about throughput and latency.
  • Strong written communication skills and ability to explain complex technical decisions clearly.

Responsibilities

  • Design tasks across kernels, profiling, debugging, and inference serving.
  • Provide accurate, well-structured solutions to expose frontier model failures on accelerator code.
  • Guide research and engineering teams to improve AI model performance on ML systems and training infrastructure.
  • Evaluate ML systems tasks and solutions.
  • Provide clear written technical feedback suitable for expert review.
  • Develop guidelines and rubrics for kernel optimization, profiler outputs, and serving throughput/latency trade-offs.
  • Collaborate with SMEs to maintain training data consistency and accuracy.

Skills

ML systems
Kernel optimization
Performance profiling
Distributed workloads
JAX/PyTorch
CUDA/TensorRT
LLM serving
vLLM

Tools

Kineto
Nsight
Torch.profiler
XLA

Job description

About the job Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

Type: Contract

Compensation: $90–$120/hour

Location: Remote

Commitment: 40 hours/week

Role Responsibilities
  • Design challenging tasks across kernels, profiling, debugging, and inference serving.
  • Write accurate, well-structured solutions to expose where frontier models fail on accelerator code.
  • Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, compilers, and training infrastructure topics.
  • Evaluate ML systems tasks and solutions.
  • Provide clear written technical feedback that stands up to expert review.
  • Develop guidelines and detailed rubrics covering kernel optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
  • Collaborate with other subject matter experts to keep training data consistent and accurate.
Qualifications Must-Have
  • 2+ years of hands-on professional experience in ML systems, ML infrastructure, model serving, or accelerator performance engineering.
  • Practical experience in writing or optimizing custom kernels (Pallas, Triton, CUDA, CUTLASS), performance profiling and trace analysis (JAX/XLA profiler, Kineto, torch.profiler, Nsight), debugging distributed or accelerator-bound workloads, serving large language models at scale (vLLM, SGLang, TensorRT-LLM, JetStream, KV cache, paged attention, continuous batching).
  • Working production experience with JAX and/or PyTorch.
  • Framework-level depth is a strong plus: custom operators, sharding and distributed training (pjit/shard_map, FSDP, Megatron, MaxText), or compiler and graph-level work (XLA/StableHLO, torch.compile, MLIR).
  • Experience with modern accelerators such as TPU (v4 to v6e), H100, B200, Trainium or MI300, and the ability to reason about throughput, latency, and memory trade-offs.
  • Demonstrable career progression.
  • Ability to engage reliably for at least 40 hours/week during weekdays.
  • Strong written communication skills and the ability to explain complex technical decisions clearly.

Compensation & Legal Hourly contractor Paid weekly via Stripe Connect

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Mlops Engineer - Ai Systems
Mlops Engineer - Ai Systems

Mercor • San Francisco (CA)

Hybrid
GBP 93,000 - 124,000
Weekly payment via Stripe
Remote work
Ml Infrastructure Expert - Fully Remote | Up To $120/Hr
Ml Infrastructure Expert - Fully Remote | Up To $120/Hr

Mercor • San Francisco (CA)

Hybrid
GBP 94,000 - 125,000
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

Parailabs • United States

Remote
USD 180,000 - 240,000
Remote work
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)
MLOps Engineer, LLM Performance (Kernels, Profiling, Serving)

Confidential • United States

Remote
USD 180,000 - 240,000
MLOps & LLM Performance Engineer — Remote
MLOps & LLM Performance Engineer — Remote

Mercor • San Francisco (CA)

Hybrid
GBP 94,000 - 125,000
ML Infrastructure and Performance Engineer, AI Expert (Remote)
ML Infrastructure and Performance Engineer, AI Expert (Remote)

Weekday AI • United States

Remote
USD 124,000 - 165,000
Remote MLOps Engineer: LLM Performance & Kernels
Remote MLOps Engineer: LLM Performance & Kernels

Mercor • United States

Remote
USD 124,000 - 165,000
Remote MLOps Engineer for AI Systems (Contract, $90–$120)
Remote MLOps Engineer for AI Systems (Contract, $90–$120)

Mercor • San Francisco (CA)

Hybrid
GBP 93,000 - 124,000
Weekly payment via Stripe
Remote work
ML Systems, LLM Post-Training
ML Systems, LLM Post-Training

ChipAgents • San Jose (CA)

On-site
USD 150,000 - 350,000
Equity
Unlimited PTO
Full benefits
+1
Remote MLOps Engineer — LLM Performance & Inference
Remote MLOps Engineer — LLM Performance & Inference

Confidential • United States

Remote
USD 180,000 - 240,000