Senior Backend Engineer: Benchmark Evaluation Systems

Creandum; Paris; Hybrid; EUR 77,000 - 118,000; Full time

Job summary

Holo4's team seeks an experienced backend engineer to build and operate the evaluation framework. You will ensure reliable, fast, and cost-efficient runs across web apps, desktops, and CLIs, integrating benchmarks and maintaining reproducible results.

You’ll work with researchers and forward deployed engineers to scale tests, enforce standards, and optimize scheduling and observability. London-based hybrid role with cross-team collaboration.

Qualifications

• 5+ years in backend development with production Python at the core.
• Experience building test, QA or evaluation tooling used by other teams.
• Operate distributed systems on Kubernetes in a public cloud; AWS helps.
• Develop end-to-end systems with APIs (REST/GraphQL) and external integrations.
• Know relational and non-relational databases and message queues.

Responsibilities

• Integrate benchmarks for researchers and forward deployed engineers to speed adoption.
• Set standards for how benchmarks enter the framework and enforce checks.
• Schedule and observe to avoid idle cluster capacity and queue delays.
• Ensure reproducible results across trials for reliable release decisions.
• Handle diverse stacks as benchmarks require, from clustering to browser extensions.
• Engage with customers to understand needs and automate results into harnesses.

Skills

Backend development

Python

Kubernetes

REST/GraphQL APIs

Observability

Docker

Tools

PostgreSQL

Grafana

Job description

Holo4's team seeks an experienced backend engineer to build and operate the evaluation framework. You will ensure reliable, fast, and cost-efficient runs across web apps, desktops, and CLIs, integrating benchmarks and maintaining reproducible results.

You’ll work with researchers and forward deployed engineers to scale tests, enforce standards, and optimize scheduling and observability. London-based hybrid role with cross-team collaboration.