Performance Engineer: Optimize GPU Inference at Scale

TechTwitter; San Francisco, Northern (CA, KY); Hybrid; USD 180,000 - 240,000; Full time

Job summary

Morph is hiring a performance engineer to make the entire system faster, cheaper, and more reliable. You will work directly with the founders on problems that determine how efficiently frontier-scale models can be served, in a small team with enormous compute and immediate production impact.

You’ll trace latency and throughput from the API layer down to individual kernels, optimize batching, routing, quantization, and distributed execution, and build benchmarks and observability to make

Qualifications

• Experience optimizing complex production systems.
• Ability to turn profiling data into engineering decisions.
• Strong Python and GPU performance knowledge.

Responsibilities

• Find the gap between theoretical hardware performance and production performance.
• Trace latency and throughput regressions from the API layer down to individual kernels.
• Optimize batching, scheduling, routing, quantization, and distributed execution.
• Build benchmarks and observability that make bottlenecks obvious.
• Work with NVLink and RoCE.
• Validate that every optimization preserves model quality and correctness.

Skills

Python

CuTEdsl

GPU performance

Profiling

Model serving

Tools

NVLink

RoCE

Job description

Morph is hiring a performance engineer to make the entire system faster, cheaper, and more reliable. You will work directly with the founders on problems that determine how efficiently frontier-scale models can be served, in a small team with enormous compute and immediate production impact.

You’ll trace latency and throughput from the API layer down to individual kernels, optimize batching, routing, quantization, and distributed execution, and build benchmarks and observability to make