AI Workflows Engineer for Scientific Pipelines

Barcelona Supercomputing Center; Barcelona; On-site; EUR 52,000 - 78,000; Full time

Benefits offered by this job

Restaurant tickets

Private health insurance

Relocation support

Job summary

The Barcelona Supercomputing Center (BSC-CNS) invites applications for a Workflows Engineer for AI processes in the RE2 project. You will develop, deploy and maintain workflow solutions for AI-driven scientific applications on HPC resources, collaborating with climate scientists and AI researchers.

Responsibilities include reproducible workflows, testing, CI, and collaboration in European research projects;Qualifications include a BSc in CS or related, Master's valued, strong Python, Linux/HPC

Qualifications

• BSc in Computer Science, Computational Science, Data Science, Artificial Intelligence, Software Engineering, or a related discipline.
• Having a Master's degree will be valued.
• Experience in scientific software development using Python.
• Experience deploying and developing workflow solutions for scientific or AI applications.
• Experience with workflow management systems (e.g. Autosubmit, Airflow, or similar).
• Experience with AI model lifecycles
• Experience working with Linux environments and HPC systems.
• Experience using version control systems (Git) and collaborative software development practices.
• Experience with container technologies such as Docker or Singularity.
• Knowledge of software engineering best practices, including testing, documentation, and continuous integration.
• Troubleshooting and debugging skills.
• Good written and spoken English.
• Understanding of HPC computer architecture issues, including CPU, accelerators, memory, interconnect, parallel I/O, and computational performance in general.
• Knowledge of HPC job schedulers (Slurm, PBS or similar).
• Knowledge of climate or Earth system modelling workflows.
• Experience participating in European or international research projects.
• Contributions to open-source software projects.

Responsibilities

• Develop, maintain, and deploy workflow solutions for AI-driven scientific applications.
• Contribute to the development of reproducible and traceable computational workflows following FAIR principles and research software engineering best practices.
• Collaborate with AI researchers, climate scientists, and software engineers to integrate new AI models into operational workflows.
• Contribute to software testing, continuous integration, documentation, and dissemination of developed technologies.
• Participate in European collaborative research projects and interact with international partners.

Skills

Python

Workflow management

Linux & HPC

Git

Docker/Singularity

CI/CD

English communication

Education

BSc in Computer Science, Computational Science, Data Science, AI, Software Engineering, or related

Master's degree valued

Tools

Autosubmit

Airflow

Git

Docker

Singularity

Slurm

Job description

The Barcelona Supercomputing Center (BSC-CNS) invites applications for a Workflows Engineer for AI processes in the RE2 project. You will develop, deploy and maintain workflow solutions for AI-driven scientific applications on HPC resources, collaborating with climate scientists and AI researchers.

Responsibilities include reproducible workflows, testing, CI, and collaboration in European research projects;Qualifications include a BSc in CS or related, Master's valued, strong Python, Linux/HPC