Founding AI Inference Engineer — Scale AI Serving

Fuse Energy; United States; Remote; USD 200,000 - 350,000; Full time

Benefits offered by this job

Equity sign-on bonus

Biannual bonus

Fully expensed tech

Meals allowance

Job summary

Fuse Energy is seeking a Founding AI Inference Engineer to define and build how we serve AI inference workloads at scale, reporting to the CTO. You will own the inference serving layer, ensuring throughput, latency, and uptime commitments across a large cluster, in collaboration with CUDA/GPU engineers.

The role combines architecture ownership with hands-on implementation, shaping a new function in a fast-growing energy-tech startup that aims to combine energy delivery with AI-scale compute.

Qualifications

• Deep, hands-on experience with inference serving frameworks and techniques to optimise them (batching, KV-cache management, quantisation, speculative decoding).
• Ability to reason about full path from incoming request to served response across a large cluster.
• Comfort working with GPU/CUDA engineers to integrate low-level performance work.

Responsibilities

• Define inference serving strategy and architecture from first principles.
• Design and build the serving stack: routing, batching, scheduling, autoscaling for high-throughput, latency-sensitive workloads.
• Own model-level optimisation strategy for serving to improve throughput and cost per token.

Skills

Inference serving

System design

Performance tuning

CUDA/GPU integration

Quantisation & distillation

ML inference frameworks

Tools

vLLM

TensorRT

Triton Inference Server

CUDA

Job description

Fuse Energy is seeking a Founding AI Inference Engineer to define and build how we serve AI inference workloads at scale, reporting to the CTO. You will own the inference serving layer, ensuring throughput, latency, and uptime commitments across a large cluster, in collaboration with CUDA/GPU engineers.

The role combines architecture ownership with hands-on implementation, shaping a new function in a fast-growing energy-tech startup that aims to combine energy delivery with AI-scale compute.