Regional Weather AI Data Engineer | Scalable Pipelines

Barcelona Supercomputing Center; Barcelona; On-site; EUR 55,000 - 75,000; Full time

Benefits offered by this job

Restaurant tickets

Private health insurance

Relocation support

Flexible working hours

Job summary

Barcelona Supercomputing Center (BSC-CNS) is seeking a Data/ML Engineer for Regional AI Weather/Climate Forecasting datasets. You will build AI-ready data pipelines, curate high-resolution simulation/observational data, and deploy/validate pipelines on HPC/AI infrastructure, in collaboration with European partners.

Requirements include a Bachelor's in CS/Physics/Environmental Science (Master's/PhD valued), strong Python, experience with NetCDF/GRIB/Zarr, Xarray, Docker, and Slurm.

Qualifications

• Bachelor's degree in CS, Physics, environmental/atmospheric science, or related field.
• Master's or PhD highly valued.
• Fluency in English; Spanish and other European languages advantageous.

Responsibilities

• Curate regional analyses, forecasts, and reanalyses for training and evaluation.
• Design and maintain reproducible ML data pipelines for Anemoi-compatible datasets.
• Implement automated testing and CI/CD for data-processing workflows.
• Support deployment/validation of pipelines on HPC and AI infrastructure.
• Collaborate with international consortium and document pipelines for reproducibility.

Skills

Python

ETL pipelines

UNIX/Linux

CI/CD

GPU workflows

Git

Xarray

NetCDF

GRIB

Zarr

Docker/Podman

Slurm

Education

Bachelor's degree in Computer Science

Physics

Environmental/Atmospheric Science

Related discipline

Tools

Anemoi

Jupyter

NWP datasets

Job description

Barcelona Supercomputing Center (BSC-CNS) is seeking a Data/ML Engineer for Regional AI Weather/Climate Forecasting datasets. You will build AI-ready data pipelines, curate high-resolution simulation/observational data, and deploy/validate pipelines on HPC/AI infrastructure, in collaboration with European partners.

Requirements include a Bachelor's in CS/Physics/Environmental Science (Master's/PhD valued), strong Python, experience with NetCDF/GRIB/Zarr, Xarray, Docker, and Slurm.