Remote MLOps Engineer for GenAI Systems

Mercor; San Francisco (CA); Remote; USD 140,000 - 200,000; Full time

Job summary

Mercor is seeking a remote ML systems engineer to join its GenAI development team. You will work on large language model infrastructure, from kernels to inference serving, across a distributed, 40-hour workweek engagement.

You'll tackle accelerators like TPU and GPUs, optimize performance, and collaborate with researchers to push frontier AI capabilities while maintaining robust, scalable systems. This fully remote role offers exposure to cutting-edge ML frameworks (JAX, PyTorch) and modern

Qualifications

• 2+ years of hands-on experience in ML systems and infrastructure.
• Experience with accelerator performance, profiling or serving large language models.
• Experience with JAX and/or PyTorch in production.
• Familiarity with TPU, H100 or similar accelerators.
• Strong written communication and ability to work 40 hours per week.

Responsibilities

• Design tasks across kernels, profiling, debugging and inference serving.
• Guide teams to improve AI model performance on ML systems and training infra.
• Evaluate ML tasks and provide clear technical feedback.
• Develop rubrics for kernel optimization, profiler outputs, and latency trade-offs.
• Collaborate to maintain training data consistency.

Skills

ML systems

ML infrastructure

model serving

accelerator performance

JAX

PyTorch

XLA

TPU

Tools

JAX

PyTorch

XLA

TPU

CUDA

Job description

Mercor is seeking a remote ML systems engineer to join its GenAI development team. You will work on large language model infrastructure, from kernels to inference serving, across a distributed, 40-hour workweek engagement.

You'll tackle accelerators like TPU and GPUs, optimize performance, and collaborate with researchers to push frontier AI capabilities while maintaining robust, scalable systems. This fully remote role offers exposure to cutting-edge ML frameworks (JAX, PyTorch) and modern