Cloud Data Infrastructure Engineer (m/f/d)

Senckenberg Gesellschaft für Naturforschung; Frankfurt; On-site; EUR 50,000 - 70,000; Part time

Benefits offered by this job

International network of scientists

Flexible working hours

Mobile working options

Free museum admission

Annual special payment

Vacation entitlement

Company pension plan

Job summary

Senckenberg Gesellschaft für Naturforschung in Frankfurt am Main is seeking a Cloud Data Infrastructure Engineer (m/f/d) to join the SDMC. The role is 25% part-time on a fixed-term contract with TV-H/E13 remuneration, contributing to a EU-funded project and open-access SDM tooling.

You will design a hybrid AWS-based data platform handling billions of records (GBIF/OBIS), implement batch pipelines, map tiles, and cost governance. Strong Python, Docker, Git/CI, and English are required.

Qualifications

• Several years designing and operating cloud data platforms (AWS S3, Batch, Spot Instances).
• Hands-on experience with columnar/lakehouse tech (Parquet, DuckDB, Spark or Dask) on billion-record datasets.
• Strong PostgreSQL, including PostGIS, and geospatial processing experience.
• Experience with biodiversity data (GBIF/OBIS) and environmental layers.
• Proficiency in Python, Docker, Git/CI; very good English.

Responsibilities

• Design and implement the data infrastructure of the Open Modular SDM Platform (lakehouse over GBIF/OBIS).
• Architect and operate a hybrid AWS setup (S3 data lake, Batch compute, optional GPU).
• Build batch pipelines, workflow orchestration (Nextflow/Snakemake), and containerisation.
• Create an H3-based aggregation and map-tile generation pipeline.
• Manage cloud costs, document infrastructure, and provide handover.
• Advise project team on infrastructure and hosting decisions.

Skills

Cloud data platforms

AWS S3/Batches

Columnar lakehouse

PostgreSQL/PostGIS

Geospatial processing

Python

Docker

Git/CI

English language

Tools

Nextflow

Snakemake

Parquet

DuckDB

Spark

Dask

Job description

Cloud Data Infrastructure Engineer (m/f/d)

Senckenberg Society for Nature Research (SGN), headquartered in Frankfurt am Main, is seeking to fill the following position in the Department of the Senckenberg Data and Modelling Center (SDMC) at the Senckenberg Research Institute and Natural History Museum Frankfurt, starting as soon as possible:

Location: Frankfurt

Employment scope: 25% Part-Time

(Part-Time: 25%)

Type of contract: Fixed Term Contract for 1 year

Remuneration: Collective agreement of the state Hesse (TV-H) / E13

The Senckenberg Society for Nature Research is a member of the Leibniz Association and has been investigating the “Earth System” worldwide for more than 200 years, examining the past, analysing the present, and developing projections for the future. We conduct integrative geobiodiversity research with the aim of understanding nature in all its complexity and diversity in order to preserve it as the foundation of life for future generations and to ensure its sustainable use. Across eight institutes and five research stations throughout Germany, scientists from more than 40 countries conduct research at the highest international level.

The city of Frankfurt, where the Senckenberg Society was originally founded, hosts the organization’s central administrative services along with two research institutes housing extensive scientific collections and one of Senckenberg’s most renowned institutions, the Senckenberg Natural History Museum Frankfurt. Senckenberg is as much a part of the city’s identity as its skyline and its traditional apple wine.

The position is within the Geobiodiversity Information and Data Management team of the Senckenberg Data and Modelling Center (SDMC) and contributes to a project funded by the European Union, TETTRIX – TETTRIs neXt level for the taxonomy of tomorrow. The team works at the interface of biodiversity informatics, ecological modelling, and data management, focusing on integrating, analysing, and making biodiversity data accessible for research and conservation. The TETTRIX project aims to strengthen taxonomic capacity for biodiversity research by developing, validating, and scaling innovative tools, workflows, services, and training pathways, while addressing critical knowledge and capacity gaps across Europe. Within the TETTRIX project, the position will contribute to and consult on developing a web-based open-access tool on Species Distribution Modelling (SDM) for reproducible data and modelling workflows and transform biodiversity data into actionable knowledge for biodiversity monitoring and conservation.

Your tasks

• Design and implement the data infrastructure of the Open Modular SDM Platform: a columnar lakehouse (Parquet, DuckDB, Dask on AWS Batch) over the full GBIF corpus (3.9 billion occurrence records) and OBIS (207 million records).
• Architect and operate the hybrid setup with the AWS side (S3 data lake, elastic batch compute, optional GPU profile), working with the institute's internal serving layer (PostgreSQL/PostGIS, tiles, API) in cooperation with central IT.
• Build the batch pipelines: monthly full-corpus rebuild, per-species extraction and SDM training jobs; workflow orchestration (Nextflow/Snakemake), containerisation.
• Build an H3-based aggregation and map-tile generation pipeline.
• Manage cloud costs, infrastructure documentation and handover.
• Advise the project team on infrastructure and hosting decisions.

Your profile

• Several years of professional experience designing and operating cloud data platforms (AWS: S3, Batch, Spot Instances; infrastructure as code).
• Hands‑on experience with columnar / lakehouse technologies (Parquet, DuckDB, Spark or Dask) on datasets in the billion‑record range.
• Strong PostgreSQL, including PostGIS.
• Experience with large‑scale geospatial processing: spatial indexing (e.g. H3 hexagonal grids) and map‑tile pipelines.
• Experience working with biodiversity occurrence data (GBIF, OBIS) and environmental layers (e.g. Bio-ORACLE).
• Knowledge ofPython, Docker, Git/CI.
• Very good command of English.

Desirable skills

• Familiarity with species distribution modelling and associated statistical/machine-learning approaches (e.g. GLM/GAM, MaxEnt, RandomForest).
• A trackrecordin reproducible scientific computing or open‑source projects.

We offer

• access to an international network of scientists, policymakers and research organizations
• an attractivejobwithintheinspired and dynamic working environmentofaninternationallyrecognized research institution
• flexibleworking hours –mobileworkingoptions –employeeIDcardwithfree admission to Senckenberg museums –annualspecialpayment –collectively agreed vacation entitlement –company pension plan

Senckenberg is committed to diversity.We benefitfromthedifferentexpertise,perspectivesandpersonalitiesofourstaffandwelcomeeveryapplicationfromqualifiedcandidates, irrespective of ethnic or cultural origin, age, gender, ethnic or cultural origin, religionor belief, age, sexual identity or and ideology, sexual orientation andidentity or disability.Womenare particularly encouragedtoapply, astheyareunderrepresentedinthefieldofthisposition;inthecaseofequalqualificationsandsuitability they will be given preference.Applicantswithaseveredisabilitywillbegiven special consideration incaseof equal suitability.Senckenbergactivelysupportsthecompatibilityofworkandfamilyandplacesgreatemphasisonanequal andinclusivework culture.

Contact

SenckenbergGesellschaftfürNaturforschung
Senckenberganlage25
60325FrankfurtamMain

For specificquestionsaboutthisrole,[e-mail]