Senior Backend Engineer, Evaluation & Benchmark Platform

H Company; Paris; Híbrido; EUR 70.000 - 110.000; Jornada completa

Descripción de la vacante

H Company in Paris is seeking a backend-focused engineer to build and run the evaluation framework powering benchmarks. You will work across the stack, ensuring reliability, speed and cost efficiency while collaborating with researchers and forward deployed engineers.

You’ll own parts of the system, from integration checks to scheduling and observability, and help scale 50 benchmarks to 100–200. Expect cross‑functional work with product and customers, aiming to deliver reproducible results that

Formación

• 5+ years in backend development with production Python at the core.
• Built test, QA or evaluation tooling that others depend on.
• Operated distributed systems on Kubernetes in a public cloud (AWS helpful).
• Built and shipped end-to-end systems, including APIs (REST/GraphQL) and integrations.
• Knowledge of relational and non-relational databases and queues (SQS/RabbitMQ/Kafka).
• Instrument what you build with metrics, tracing and monitoring.

Responsabilidades

• Integration support for researchers and forward deployed engineers bringing in a benchmark, with a shorter path each time.
• Setting the standard for how a benchmark enters the framework, and building the checks that enforce it.
• Scheduling and observability, so cluster capacity isn't left idle while evaluation jobs queue.
• Reproducible results across trials, so a release decision rests on numbers that hold.
• Whatever stack a benchmark calls for. One week that's cluster tuning; the next it's a browser extension or desktop environments.
• Time with customers, from single developers to large companies, to find out what they want measured, then automating it so the results flow back into our harnesses and models.

Conocimientos

Python

Backend

Kubernetes

Distributed systems

Herramientas

AWS

Docker

PostgreSQL

Grafana

Datadog

Descripción del empleo

H Company in Paris is seeking a backend-focused engineer to build and run the evaluation framework powering benchmarks. You will work across the stack, ensuring reliability, speed and cost efficiency while collaborating with researchers and forward deployed engineers.

You’ll own parts of the system, from integration checks to scheduling and observability, and help scale 50 benchmarks to 100–200. Expect cross‑functional work with product and customers, aiming to deliver reproducible results that