System Engineer for a Cloud-like HPC Infrastructure

ETH SINGAPORE SEC LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Benefits offered by this job

Flexible hybrid work

Annual dental benefits

Healthcare insurance

Job summary

The Singapore-ETH Centre invites applications for a System Engineer to lead the cloud-like HPC infrastructure for the AIS Instrumentation Gym. You will oversee the end-to-end research platform for AI4S workflows, ensuring secure cross-site data movement and scalable storage solutions for long-term reproducibility.

You will implement infrastructure as code with Ansible and Terraform/OpenTofu, manage OpenCHAMI and Kubernetes deployments, and enable multi-tenant vClusters across sites.

Qualifications

• A bachelor’s degree or higher in computer engineering, computer science, a relevant technical field, or equivalent practical experience.
• Knowledge of microservice architecture and distributed/federated research infrastructure.
• Experience with CI/CD pipelines and automation tooling such as Gitlab CI and HashiCorp Vault.
• Hands-on experience developing Ansible configurations and using ArgoCD for deployments.
• Proficiency with Kubernetes and OpenCHAMI; familiarity with IaC tools like Terraform/OpenTofu.
• Understanding HPC workflows, data retention policies, and secure multi-site data transfer.

Responsibilities

• Manage the HPC backbone for the AIS Instrumentation Gym, serving as an end-to-end research platform for AI4S workflows.
• Implement data mobility protocols for seamless, secure data movement between distributed research sites (e.g., NUS, NTU, NSCC, CSCS).
• Design and implement tiered storage and data retention policies to balance fast-access for training with reproducibility.
• Develop workflows for federated reproducibility across HPC locations to minimize duplication of effort.
• Provision core IT infrastructure using IaC tools (Ansible, Terraform/OpenTofu) and manage the system management platform OpenCHAMI and Kubernetes.
• Administer multi-tenant vClusters and dynamic vService creation in the management plane.

Skills

Microservice architecture

CI/CD pipelines

Ansible configurations

Kubernetes

Terraform/OpenTofu (IaC)

Distributed/federated infra

HPC workflows

Security and data transfer

Education

Bachelor’s degree in computer engineering/science or equivalent

Tools

Gitlab CI

HashiCorp Vault

ArgoCD

OpenCHAMI

Ansible

Kubernetes (tooling)

Terraform/OpenTofu

Job description

Project background

The AIS Instrumentation Gym is a multi-tier ML platform being built by both the National University of Singapore and the Singapore-ETH Centre (SEC) for shared scientific instruments (e.g., electron microscopy, X-ray imaging, and light microscopy). It supports researchers across three compute scales: laptop-based prototyping (S-Gym), single-GPU workstations (M-Gym), and multi-node HPC at the National Supercomputing Centre Singapore (L-Gym).

The Gym's purpose is to close the gap between high-dimensional scientific data and hypothesis generation. It does this by turning raw imaging data into learned, interpretable representations that scientists can explore as navigable landscapes: making patterns, anomalies, and structure legible at scales human intuition can no longer reach unaided.

As an ecosystem, the Gym brings together domain scientists, ML researchers, and systems builders around a common platform. We are now hiring full-time engineers and researchers to build, validate, and scale it.

Job description

As a System Engineer for a Cloud-like HPC Infrastructure you will:

• Manage the HPC backbone for the AIS Instrumentation Gym, serving as a one-stop, end-to-end research platform for AI4S workflows.
• Implement integrated data mobility protocols to ensure seamless, secure data movement between distributed research sites (e.g., NUS, NTU, NSCC, CSCS).
• Manage sustainable data retention policies, implementing tiered storage solutions that balance fast-access for active training with archival for long-term reproducibility.
• Support federated reproducibility by developing workflows that allow dataset cloning/forking across multiple HPC locations to reduce duplication of effort.
• Manage and provision the core IT infrastructure using IaC tools (Ansible, Terraform/OpenTofu).
• Install and manage the system management platform (OpenCHAMI) and container orchestration system (Kubernetes).
• Administer the management plane to support multi-tenant vClusters and dynamic vService creation.

Position requires quarterly travel to Switzerland to synchronise with the core Swiss team. Join us to operate a HPC infrastructure at the bleeding edge of innovation, driving impact within a world-class tech stack.

Selection Criteria

Applicants to the position,

Must-haves:

• A bachelor’s degree or higher in computer engineering, computer science, a relevant technical field, or equivalent practical experience.
• You should have a knowledge of:

1. Microservice architecture
2. Automation tools and framework, including CI/CD processes and ecosystem (e.g., Gitlab CI, HashiCorp Vault)
3. Developing Ansible configurations
4. Versioning systems and CI/CD workflows such as ArgoCD
5. Kubernetes
6. Learn OpenCHAMI
7. IaC tools like Terraform/OpenTofu
8. Experience with distributed or federated research infrastructure (e.g., cross-site data transfer, secure multi-site authentication).
9. Understanding of HPC workflows and data retention policies in a multi-tenant research environment.

Preferred:

• Experience with data-centric HPC workloads and cross-site research infrastructure.
• Familiarity with the research lifecycle (data cleaning, provenance tracking, and model lifecycle management).
• Personal qualities:

1. Self-motivated and proactive team player
2. Strong communication skills or interest in developing them
3. Strong problem-solving mindset with tolerance for uncertainty andchange
4. Understands user needs and works collaboratively to address them
5. Adaptive and willing to learn new technologies with and fromothers
6. Comfortable tackling complex or ambiguous problems
7. Comfortable admitting when you don’t know, reaching out and leveraging the right expertise when needed

• Project management and methodology:

1. Experience with working in self-organised teams
2. Familiarity with Agile methodology
3. Experience with test-driven development is a plus

Why SEC is your employer of choice?

• Accredited with 5 Tripartite Standards by Tripartite Alliance for Fair & Progressive Employment Practices (TAFEP) Singapore.
• A diverse workplace with 32 nationalities, offering ample opportunities for mutual learning.
• Positive and inclusive working environment.
• 25 days of annual leave for fixed-term contracts.
• 1 day of Birthday Leave.
• Annual dental benefits.
• Committed to being a supportive employer as you prioritize your physical and mental wellness.
• Comprehensive healthcare insurance coverage.
• Flexible hybrid work arrangement (up to 2 days per week from home).
• Abundant networking opportunities across various disciplines.
• Accredited with NS mark certification.

The Singapore-ETH Centre is an equal opportunity and family-friendly employer. All candidates will be evaluated on their merits and qualifications, without regards to gender, race, age or religion.

Curious? So are we.

Work location: 1 Create Way, CREATE Tower, Singapore 138602 (NUS University Town)
Contract Duration: 2 Years

Further information about The Singapore-ETH Centre can be found on our website: https://sec.ethz.ch/

For further information, please contact: Prof. Duane Loh (NUS) at [e-mail], (strictly no applications)