Senior DevOps Engineer (HPC)

Xebia; Murcia; Presencial; EUR 50.000 - 65.000; Jornada completa

Descripción de la vacante

A leading technology consultancy is seeking a Senior DevOps-HPC Engineer to lead the migration of HPC clusters to Google Cloud Platform. Ideal candidates will have at least 5 years of experience with HPC environments and SLURM, along with strong skills in Python and automation tools. This role requires designing and managing HPC infrastructure, optimizing configurations, and collaborating with teams to enhance performance. Competitive compensation and a dynamic working environment await the right candidate.

Formación

• Minimum 5 years of experience with HPC environments.
• Extensive hands-on experience managing Linux-based systems.
• Proficiency with automation tools such as Ansible and Terraform.

Responsabilidades

• Lead the migration of on-premises SLURM-based HPC clusters to GCP.
• Design and manage scalable and secure HPC infrastructure on GCP.
• Optimize SLURM configurations to ensure efficient cloud resource use.

Conocimientos

HPC environments

SLURM workload manager

Python scripting

Bash scripting

GCP services

Ansible

Terraform

MPI and OpenMP

Herramientas

GCP

Spack

Terraform

Ansible

Descripción del empleo

About us
For more than 20 years, our global network of passionate technologists and pioneering craftspeople has delivered cutting-edge technology and game-changing consulting to companies on the brink of AI-driven digital transformation. Since 2001, we have grown into a full-service digital consulting company with 5500+ professionals working on a worldwide ambition. Driven by the desire to make a difference, we keep innovating, fueling the growth of our company with our knowledge worker culture. When teaming up with Xebia, expect in-depth expertise based on an authentic, value-led, and high-quality way of working that inspires all we do. At Xebia, we put ‘People First’—committed to attracting diverse talent and fostering an inclusive, respectful workplace where everyone is valued for their contributions. We welcome all individuals and evaluate solely on the quality of their work and teamwork.

About the Role
As a Senior DevOps-HPC Engineer at Xebia, you will join a dynamic engineering team in a high-energy and collaborative environment. This role is ideal for a seasoned HPC engineer with deep expertise in SLURM, Linux, and cloud migration, who thrives on leading complex projects, designing robust architectures, and implementing high-performance solutions in Google Cloud Platform (GCP).
Responsibilities:

1. Lead the migration of on-premises SLURM-based HPC clusters to GCP.
2. Design, implement, and manage scalable and secure HPC infrastructure solutions on GCP.
3. Optimize SLURM configurations and workflows to ensure efficient use of cloud resources.
4. Manage and optimize HPC environments, focusing on workload scheduling, job efficiency, and scaling SLURM clusters.
5. Automate cluster deployment, configuration, and maintenance tasks using scripting languages (Python, Bash) and automation tools (Ansible, Terraform).
6. Integrate HPC software stack using tools like Spack for dependency management and easy installation of HPC libraries and applications.
7. Deploy, manage, and troubleshoot applications using MPI, OpenMP, and other parallel computing frameworks on GCP instances.
8. Collaborate with engineering, support teams, and stakeholders to ensure smooth migration and ongoing operation of HPC workloads.
9. Provide expert-level support for performance tuning, job scheduling, and cluster resource optimization.
10. Stay current with emerging HPC technologies and GCP services to continually improve HPC cluster performance and cost efficiency.

Requirements :
Basics: Minimum 5 years of experience with HPC environments, including SLURM workload manager, MPI, and other HPC-related software. Extensive hands-on experience managing Linux-based systems, including performance tuning and troubleshooting in an HPC context. Proven experience migrating and managing SLURM clusters in cloud environments, preferably GCP. Proficiency with automation tools such as Ansible and Terraform for cluster deployment and management. Experience with Spack for managing and deploying HPC software stacks. Strong scripting skills in Python, Bash, or similar languages for automating cluster operations. In-depth knowledge of GCP services relevant to HPC, such as Compute Engine (GCE), Cloud Storage, and VPC networking. Strong problem-solving skills with a focus on optimizing HPC workloads and resource utilization.
Recommended: Google Cloud Professional DevOps Engineer or similar GCP certifications. Familiarity with GCP’s HPC-specific offerings, such as Preemptible VMs, HPC VM images, and other cost-optimization strategies. Experience with performance profiling and debugging tools for HPC applications. Advanced knowledge of HPC data management strategies, including parallel file systems and data transfer tools. Understanding of container technologies (e.g., Singularity, Docker) specifically within HPC contexts. Experience with Spark or other big data tools in an HPC environment is a plus. Focusing now on modules/libs migration, so expertise on Spack containers, Pipelines (GHA).