High-Performance AI Inference Engineer

F5 Networks, Inc.; San Jose (CA); Hybrid; USD 177,000 - 265,000; Full time

Job summary

F5 Networks, Inc. is seeking an AI Inference Engineer to optimize LLM inference from data centers to edge devices. You will fine-tune software stacks, hardware backends, and orchestration to maximize throughput while preserving model accuracy.

You will work with vLLM, TensorRT, Llama.cpp, and Ollama, plus Kubernetes for real-time and batch inference, ensuring reliable, scalable AI endpoints across environments.

Qualifications

• Proficiency in Python, C++, Rust, or Golang for high-performance AI workflows.

Responsibilities

• High-Performance AI Serving: Build and maintain inference engines with vLLM, TGI, and NVIDIA Triton for scalable performance.

Skills

Python

C++

Rust

Golang

vLLM

TensorRT

Llama.cpp

Ollama

Docker

Kubernetes

AWS

GCP

Azure

CUDA

Triton

MLOps

SRE

Tools

TensorRT

Llama.cpp

Ollama

Job description

F5 Networks, Inc. is seeking an AI Inference Engineer to optimize LLM inference from data centers to edge devices. You will fine-tune software stacks, hardware backends, and orchestration to maximize throughput while preserving model accuracy.

You will work with vLLM, TensorRT, Llama.cpp, and Ollama, plus Kubernetes for real-time and batch inference, ensuring reliable, scalable AI endpoints across environments.