AI Systems Infra Engineer — Real-Time GPU Inference

Menlo Security; Bracknell; Presencial; GBP 120.000 - 180.000; Jornada completa

Descripción de la vacante

Menlo Security seeks an AI Systems Infrastructure Engineer (IC4) to lead backend architecture powering real-time security detection services. You will build low-latency, scalable serving pipelines for SLMs, PI engines, and classification platforms on GPU and cloud clusters.

You will optimize GPU replicas, guardrails, and automated evaluation pipelines while collaborating with ML researchers. The role emphasizes production backend services, microservices, container orchestration, and CI/CD with a

Formación

• 5+ years of software engineering experience building distributed backend systems or high-throughput microservices.
• Proven track record in model serving and inference optimization (e.g., TensorRT, vLLM, ONNX Runtime, Triton Inference Server).
• Hands-on expertise with Kubernetes, container orchestration, GPU scheduling, and infrastructure auto-scaling.
• Strong programming experience in Python, Go, or C++.
• Solid understanding of CI/CD pipelines, MLOps/LLMops principles, and cloud infrastructure (AWS/GCP).

Responsabilidades

• Architect, build, and optimize production serving pipelines for Small Language Models (SLMs) and traditional ML models using model quantization, batching, and GPU acceleration.
• Own and scale backend microservices (e.g., sds-service-prompt-injection, sds-service-ddr) delivering real-time threat detection.
• Build consumption-based monitoring, tenant rate-limiting, and runtime guardrail infrastructure.
• Manage and optimize GPU cluster replicas (Kubernetes / Pod infrastructure) to minimize cold-start times and manage infrastructure costs.
• Build continuous evaluation, automated retraining pipelines, model CI/CD, and automated regression gates to test model detection quality against live benchmarks.
• Refactor legacy service boundaries, service-to-service auth flows, and backend database configurations.

Conocimientos

Distributed backend

Model serving

Python

Go

C++

Kubernetes

CI/CD

Cloud (AWS/GCP)

Descripción del empleo

Menlo Security seeks an AI Systems Infrastructure Engineer (IC4) to lead backend architecture powering real-time security detection services. You will build low-latency, scalable serving pipelines for SLMs, PI engines, and classification platforms on GPU and cloud clusters.

You will optimize GPU replicas, guardrails, and automated evaluation pipelines while collaborating with ML researchers. The role emphasizes production backend services, microservices, container orchestration, and CI/CD with a