GPU Kernel Quality & Performance Engineer

Mercor; New York (NY); Remote; USD 150,000 - 190,000; Full time

Job summary

Mercor is seeking an experienced evaluator to assess GPU/accelerator kernel development tasks used to train and evaluate frontier AI models. You will judge numerical correctness, performance benchmarking fairness, and task scoping across diverse kernel types, ensuring accurate compilation and runtime behavior.

Responsibilities include providing rubric-based written feedback and guiding improvements to kernel development work.

Qualifications

• 3+ years of hands-on experience developing, optimizing, or verifying GPU/accelerator kernels in at least two of CUDA, Triton, NKI, or Pallas (JAX).
• Strong understanding of numerical-correctness criteria for kernels (absolute/relative/ULP tolerances, reference-implementation selection).
• Experience with performance profiling and benchmarking (nsight, ncu, roofline analysis, or framework-native profilers).
• Familiarity with common compilation and runtime failure modes (driver mismatches, OOM, launch-configuration errors, shape/stride mismatches, autotuning failures).
• Experience with at least three kernel task types: generation from specification, translation/lowering across frameworks, migration between hardware targets, debugging, performance optimization, or operator fusion.

Responsibilities

• Evaluate the quality, correctness, and completeness of GPU/accelerator kernel development tasks.
• Assess numerical correctness, performance benchmarking fairness, and task scoping.
• Provide rubric-based written feedback across diverse kernel task types.

Skills

CUDA

Triton

Kernel development

Performance profiling

Tools

Nsight

NVCU

Roofline

Job description

Mercor is seeking an experienced evaluator to assess GPU/accelerator kernel development tasks used to train and evaluate frontier AI models. You will judge numerical correctness, performance benchmarking fairness, and task scoping across diverse kernel types, ensuring accurate compilation and runtime behavior.

Responsibilities include providing rubric-based written feedback and guiding improvements to kernel development work.