Lead GPU Kernel & AI Performance Engineer

Mercor; San Francisco (CA); On-site; USD 150,000 - 210,000; Full time

Job summary

Mercor seeks a skilled evaluator to assess GPU/kernel tasks for frontier AI models. You will examine numerical correctness, performance benchmarks, and task scoping across diverse kernels, then deliver rubric-based feedback on methods and outcomes.

Responsibilities include verifying compilation/runtime validity and identifying failure modes, with emphasis on reproducibility and precision.

Qualifications

• 3+ years hands-on experience developing, optimizing, or verifying GPU/accelerator kernels in CUDA, Triton, NKI, or Pallas (JAX).
• Strong understanding of numerical-correctness criteria for kernels (absolute/relative/ULP tolerances).
• Experience with performance profiling and benchmarking (nsight, ncu, roofline analysis).
• Familiarity with common compilation and runtime failure modes.

Responsibilities

• Evaluate quality, correctness, and completeness of GPU/accelerator kernel development tasks used to train and evaluate a frontier AI lab's models.
• Assess numerical correctness, performance-benchmarking fairness, and task scoping across diverse kernel task types.
• Provide rubric-based written feedback on results and methods.

Skills

Numerical correctness

Performance profiling

Kernel development

Task scoping

Tools

CUDA

Triton

NKI

Pallas/JAX

Job description

Mercor seeks a skilled evaluator to assess GPU/kernel tasks for frontier AI models. You will examine numerical correctness, performance benchmarks, and task scoping across diverse kernels, then deliver rubric-based feedback on methods and outcomes.

Responsibilities include verifying compilation/runtime validity and identifying failure modes, with emphasis on reproducibility and precision.