Hybrid/Remote Senior AI Inference Engineer

F5 Networks, Inc.; Dublin; Hybrid; EUR 120,000 - 180,000; Full time

Job summary

F5 Networks, Inc. is seeking an AI Inference Engineer to bridge high-performance model development and optimized deployment environments.

The role focuses on optimizing Large Language Models for inference across data centers and edge devices, prioritizing throughput, low latency, and accuracy. You will build scalable inference engines with vLLM, TensorRT, Llama.cpp, and Ollama, and optimize hardware usage on NVIDIA GPUs, Apple Silicon, TPUs, and other accelerators.

Qualifications

• Programming in Python, C++, Rust or Go for high-performance AI workflows.
• Experience with vLLM, TensorRT, Llama.cpp or Ollama for inference development.
• Familiarity with Docker, Kubernetes and cloud platforms (AWS, GCP, Azure).
• Understanding hardware optimization for GPUs/TPUs in AI workloads.

Responsibilities

• Build and maintain high-performance AI serving engines for low latency inference.
• Profile and optimize models on NVIDIA GPUs, Apple Silicon and other accelerators.
• Design auto-scaling architectures using Kubernetes for online and batch inference.
• Establish observability to monitor TTFT, tokens/second, and memory bandwidth against SLAs.

Skills

Python

C++

Rust

Golang

Tools

vLLM

TensorRT

Llama.cpp

Ollama

Job description

F5 Networks, Inc. is seeking an AI Inference Engineer to bridge high-performance model development and optimized deployment environments.

The role focuses on optimizing Large Language Models for inference across data centers and edge devices, prioritizing throughput, low latency, and accuracy. You will build scalable inference engines with vLLM, TensorRT, Llama.cpp, and Ollama, and optimize hardware usage on NVIDIA GPUs, Apple Silicon, TPUs, and other accelerators.