Senior Backend Engineer — Evaluation Framework & Benchmarks

H Company; Paris; Hybrid; EUR 101,000 - 142,000; Full time

Job summary

Holo4 evaluation engineering role based in London requires 5+ years in backend development with Python, Kubernetes, and AWS.

You will integrate benchmarks, set framework entry standards, and ensure reproducible results across trials while collaborating with researchers and forward deployed engineers. The role offers hybrid London work, with a closing 3.5-hour interview process and a competitive package.

Qualifications

• 5+ years in backend development with production Python at the core.
• Experience building and shipping end-to-end systems with APIs and external services.
• Comfort operating distributed systems on Kubernetes in public cloud (AWS preferred).

Responsibilities

• Integrate researchers and forward deployed engineers with benchmarks into the framework.
• Set the standard for how benchmarks enter the framework and enforce checks.
• Schedule and monitor evaluations to maximize cluster utilization.
• Ensure reproducible results across trials to support release decisions.
• Familiarity with diverse stacks as benchmarks require, from web to desktop contexts.
• Engage with customers to understand measurement needs and automate data flow.

Skills

Backend development

Python

Kubernetes

AWS

Distributed systems

APIs (REST/GraphQL)

Tools

Docker

PostgreSQL

Grafana

Datadog

Temporal

Job description

Holo4 evaluation engineering role based in London requires 5+ years in backend development with Python, Kubernetes, and AWS.

You will integrate benchmarks, set framework entry standards, and ensure reproducible results across trials while collaborating with researchers and forward deployed engineers. The role offers hybrid London work, with a closing 3.5-hour interview process and a competitive package.