HPC Sustainability Backend Engineer

European Molecular Biology Laboratory; Cambridgeshire and Peterborough; Hybrid; GBP 42,000 - 54,000; Full time

Benefits offered by this job

Hybrid working patterns

30 days annual leave

Campus facilities: library, gym & cafe

On-site nursery

Job summary

EMBL-EBI is seeking a production‑grade Python backend developer for the HPC sustainability program. You will build data pipelines to process HPC telemetry, measure energy use, and quantify carbon footprint in collaboration with the Green Algorithms team at Cambridge.

The role combines independent production code work with cross‑team coordination and documentation. You will contribute to timeseries data storage and visualization, including Grafana dashboards, and help align tooling with

Qualifications

• This is production-grade Python data pipelines, not web API work.
• Experience with PostgreSQL and time-series data management, including TimescaleDB.
• Familiarity with Kafka and real-time data processing is required.
• Proficient with pandas for data transformation and analysis.

Responsibilities

• Develop and maintain Python-based backend services processing HPC telemetry and energy metrics.
• Collaborate with the Cambridge GA team to integrate real-time monitoring into the GA codebase.
• Work with time series databases for storage, aggregation, and retrieval of large telemetry data.
• Extend carbon and energy reporting tooling and support Grafana dashboards.
• Produce technical docs and share knowledge across EMBL-EBI and Cambridge teams.

Skills

Python backend

PostgreSQL

TimescaleDB

Apache Kafka

pandas

Git

pytest

ruff

Poetry

CI/CD

AI-assisted development

Tools

Grafana

Job description

EMBL-EBI is seeking a production‑grade Python backend developer for the HPC sustainability program. You will build data pipelines to process HPC telemetry, measure energy use, and quantify carbon footprint in collaboration with the Green Algorithms team at Cambridge.

The role combines independent production code work with cross‑team coordination and documentation. You will contribute to timeseries data storage and visualization, including Grafana dashboards, and help align tooling with