System Engineer for a Cloud-like HPC Infrastructure

Eidgenössische Technische Hochschule Zürich; Singapore; On-site; SGD 110,000 - 180,000; Full time

Benefits offered by this job

Flexible hybrid work

Healthcare coverage

25 days annual leave

Birthday leave

Job summary

The Singapore-ETH Centre is hiring a System Engineer for a Cloud-like HPC Infrastructure to support AI4S workflows across sites including NUS, NTU, NSCC, and CSCS. The role involves end-to-end platform management, data movement, and tiered storage strategies for reproducibility.

Expect quarterly travel to Switzerland to align with the core Swiss team. This full-time position offers a hybrid work arrangement and opportunities to work on a cutting-edge ML platform in a global research context.

Qualifications

• Must-haves: a bachelor’s degree or higher in computer engineering, computer science, a relevant technical field, or equivalent practical experience.
• Automation tools and CI/CD processes including Gitlab CI, HashiCorp Vault
• Developing Ansible configurations
• Versioning systems and CI/CD workflows such as ArgoCD
• Learn OpenCHAMI
• IaC tools like Terraform/OpenTofu
• Experience with distributed or federated research infrastructure (e.g., cross-site data transfer, secure multi-site authentication).
• Understanding HPC workflows and data retention policies in a multi-tenant research environment.

Responsibilities

• Manage the HPC backbone for the AIS Instrumentation Gym as end-to-end research platform for AI4S workflows.
• Implement integrated data mobility protocols between distributed research sites.
• Manage sustainable data retention policies with tiered storage for fast-access and archival.
• Support federated reproducibility by enabling dataset cloning/forking across multiple HPC locations.
• Manage and provision core IT infrastructure using IaC tools (Ansible, Terraform/OpenTofu).
• Install and manage system management platform (OpenCHAMI) and container orchestration (Kubernetes).
• Administer the management plane for multi-tenant vClusters and dynamic vService creation.

Skills

Automation tools

CI/CD processes

Gitlab CI

HashiCorp Vault

Ansible configurations

ArgoCD

OpenCHAMI

Terraform/OpenTofu

HPC workflows

Data retention policies

Distributed research infra

Version control

Education

Bachelor’s degree or higher in computer engineering, computer science, or related field

Tools

Gitlab CI

HashiCorp Vault

Job description

System Engineer for a Cloud-like HPC Infrastructure

The Singapore-ETH Centre was established in 2010 by ETH Zurich - The Swiss Federal Institute of Technology and Singapore’s National Research Foundation (NRF), as part of the NRF’sCREATE campus. As ETH Zurich's only research centre outside of Switzerland, the centre has strengthened the research capacity of ETH Zurich to develop sustainable solutions to global challenges in Switzerland, Singapore and the surrounding regions.

The centre serves as an intellectual hub for research, bringing together principal investigators and researchers from diverse disciplines and backgrounds. To promote the exchange of ideas and expertise, our researchers actively collaborate with universities and research institutes and engage with industry and government agencies to translate knowledge to practical solutions to real-world problems.

Project background

The AIS Instrumentation Gym is a multi-tier ML platform being built by both the National University of Singapore and the Singapore-ETH Centre (SEC) for shared scientific instruments (e.g., electron microscopy, X-ray imaging, and light microscopy). It supports researchers across three compute scales: laptop-based prototyping (S-Gym), single-GPU workstations (M-Gym), and multi-node HPC at the National Supercomputing Centre Singapore (L-Gym).

The Gym's purpose is to close the gap between high-dimensional scientific data and hypothesis generation. It does this by turning raw imaging data into learned, interpretable representations that scientists can explore as navigable landscapes: making patterns, anomalies, and structure legible at scales human intuition can no longer reach unaided.

As an ecosystem, the Gym brings together domain scientists, ML researchers, and systems builders around a common platform. We are now hiring full-time engineers and researchers to build, validate, and scale it.

As a System Engineer for a Cloud-like HPC Infrastructure you will:

• Manage the HPC backbone for the AIS Instrumentation Gym, serving as a one-stop, end-to-end research platform for AI4S workflows.
• Implement integrated data mobility protocols to ensure seamless, secure data movement between distributed research sites (e.g., NUS, NTU, NSCC, CSCS).
• Manage sustainable data retention policies, implementing tiered storage solutions that balance fast-access for active training with archival for long-term reproducibility.
• Support federated reproducibility by developing workflows that allow dataset cloning/forking across multiple HPC locations to reduce duplication of effort.
• Manage and provision the core IT infrastructure using IaC tools (Ansible, Terraform/OpenTofu).
• Install and manage the system management platform (OpenCHAMI) and container orchestration system (Kubernetes).
• Administer the management plane to support multi-tenant vClusters and dynamic vService creation.

Position requires quarterly travel to Switzerland to synchronise with the core Swiss team. Join us to operate a HPC infrastructure at the bleeding edge of innovation, driving impact within a world-class tech stack.

Profile

Must-haves:

• A bachelor’s degree or higher in computer engineering, computer science, a relevant technical field, or equivalent practical experience.
• You should have a knowledge of:
• Automation tools and framework, including CI/CD processes and ecosystem (e.g., Gitlab CI, HashiCorp Vault)
• Developing Ansible configurations
• Versioning systems and CI/CD workflows such as ArgoCD
• Learn OpenCHAMI
• IaC tools like Terraform/OpenTofu
• Experience with distributed or federated research infrastructure (e.g., cross-site data transfer, secure multi-site authentication).
• Understanding of HPC workflows and data retention policies in a multi-tenant research environment.

Preferred:

• Experience with data-centric HPC workloads and cross-site research infrastructure.
• Familiarity with the research lifecycle (data cleaning, provenance tracking, and model lifecycle management).
• Self-motivated and proactive team player
• Strong communication skills or interest in developing them
• Strong problem-solving mindset with tolerance for uncertainty and change
• Understands user needs and works collaboratively to address them
• Adaptive and willing to learn new technologies with and from others
• Comfortable tackling complex or ambiguous problems
• Comfortable admitting when you don't know, reaching out and leveraging the right expertise when needed
• Project management and methodology:
• Experience with working in self-organised teams
• Familiarity with Agile methodology
• Experience with test-driven development is a plus

Workplace

We offer

• Accredited with 5 Tripartite Standards by Tripartite Alliance for Fair & Progressive Employment Practices (TAFEP) Singapore.
• A diverse workplace with 32 nationalities, offering ample opportunitiesfor mutual learning.
• Positive and inclusive working environment
• 25 days of annual leave for fixed-term contracts
• 1 day of Birthday Leave
• Committed to being a supportive employer as you prioritize your physical and mental wellness
• Comprehensive healthcare insurance coverage
• Flexible hybrid work arrangement (up to 2 days per week from home)
• Accredited with NS mark certification

The Singapore-ETH Centre is an equal opportunity and family-friendly employer. All candidates will be evaluated on their merits and qualifications, without regards to gender, race, age or religion.

In line with our values, ETH Zurich encourages an inclusive culture. We promote equality of opportunity, value diversity and nurture a working and learning environment in which the rights and dignity of all our staff and students are respected. Visit our Equal Opportunities and Diversity website to find out how we ensure a fair and open environment that allows everyone to grow and flourish. Sustainability is a core value for us – we are consistently working towards a climate-neutral future.

Work location: 1 Create Way, CREATE Tower, Singapore 138602 (NUS University Town)

Contract Duration: 2 Years

Salary: Remuneration will be commensurate with the candidate's qualifications and relevant experience.

Further information about The Singapore-ETH Centre can be found on our website.

The Singapore-ETH Centre provides a multicultural and interdisciplinary environment to researchers working on diverse themes focussed on sustainable and liveable cities, resilient urban systems, and patient-centric healthcare. The centre is home to a community of over 100 doctoral, postdoctoral and professorial researchers working in three main programmes: Future Cities Laboratory, Future Resilient Systems, and Future Health Technologies.