Part-Time NKI Kernel Engineer: Trainium & CUDA Migration

24-Mag Llc; New York, Northern (NY, KY); Hybrid; USD 83,000 - 110,000; Part time

Job summary

24-MAG LLC is offering a specialised part-time consulting opportunity for experienced kernel engineers with hands-on Neuron Kernel Interface (NKI) expertise. You will focus on evaluating NKI kernel development tasks for technical correctness, hardware appropriateness, numerical fidelity, and performance quality in a fully remote capacity across the United States.

The role covers CUDA-to-NKI migrations, tile-based computation, memory hierarchy management (SBUF, PSUM, HBM), DMA orchestration, and

Qualifications

• 2+ years hands-on kernel experience with the Neuron Kernel Interface (NKI).
• Experience targeting AWS Trainium or Inferentia2 hardware.
• Experience with CUDA-to-NKI migrations.
• Strong understanding of tile-based computation and memory hierarchies.
• Ability to provide rubric-based technical feedback and precise recommendations.

Responsibilities

• Evaluate NKI kernels for correctness and hardware suitability.
• Review CUDA kernels migrated to NKI for semantic preservation.
• Assess tile-based computation and memory movement strategies.
• Evaluate Trainium-specific performance and profiling evidence.
• Provide clear, rubric-based written feedback and recommendations.

Skills

NKI Experience

Trainium Hardware

Kernel Development

CUDA Migration

Performance Optimization

NKI Libraries

Tools

AWS Neuron SDK

Neuron Compiler

NKI Tooling

Job description

24-MAG LLC is offering a specialised part-time consulting opportunity for experienced kernel engineers with hands-on Neuron Kernel Interface (NKI) expertise. You will focus on evaluating NKI kernel development tasks for technical correctness, hardware appropriateness, numerical fidelity, and performance quality in a fully remote capacity across the United States.

The role covers CUDA-to-NKI migrations, tile-based computation, memory hierarchy management (SBUF, PSUM, HBM), DMA orchestration, and