Remote Inference Systems Engineer — GPU/CUDA Focus

Undisclosed; United States; Remote; USD 200,000 - 300,000; Full time

Job summary

Undisclosed, an early-stage AI infrastructure startup, seeks a systems/infrastructure engineer to optimize large-language-model inference. You will focus on latency and throughput, including batching and quantization, and write and tune kernels using CUDA and Triton while deploying on heterogeneous GPU clusters.

Ideal candidates have 1–6 years in systems engineering, comfort with CUDA/Triton or GPU programming, and experience with cluster operations.

Qualifications

• 1-6 years in systems/infrastructure engineering.
• Familiarity with CUDA, Triton, or GPU programming and cluster operations.

Responsibilities

• Optimize inference systems for latency and throughput, including batching and quantization.
• Write and tune kernels using CUDA and Triton; deploy heterogeneous clusters.

Skills

GPU programming

Tools

CUDA

Triton

Job description

Undisclosed, an early-stage AI infrastructure startup, seeks a systems/infrastructure engineer to optimize large-language-model inference. You will focus on latency and throughput, including batching and quantization, and write and tune kernels using CUDA and Triton while deploying on heterogeneous GPU clusters.

Ideal candidates have 1–6 years in systems engineering, comfort with CUDA/Triton or GPU programming, and experience with cluster operations.