Staff Platform Engineer - High Performance Computing Platform Management

Centre for Strategic Infocomm Technologies; Singapore; On-site; SGD 70,000 - 100,000; Full time

Benefits offered by this job

Excellent engineering culture

Work-life balance

Opportunity for innovation

Job summary

A governmental technology agency is seeking an experienced HPC Staff Engineer in Singapore to manage and optimize its HPC infrastructure platform. This role involves leading a team to deliver resilient and scalable HPC solutions while ensuring high performance and availability. Candidates should possess over 8 years of experience in HPC systems management and have strong expertise in networking, Linux systems, and cloud computing. This is a unique opportunity to work with cutting-edge technologies in a supportive environment.

Qualifications

• 8+ years of experience in managing HPC systems.
• Strong knowledge of HPC architectures, including clusters and grids.
• Experience with machine learning or deep learning frameworks is a plus.

Responsibilities

• Lead a team to deliver resilient HPC platform.
• Design and implement storage solutions for HPC workloads.
• Manage HPC clusters, optimizing and troubleshooting performance.

Skills

Managing HPC systems

HPC architectures knowledge

Experience with Linux and Unix

High-performance networking

Scripting languages (Python, Perl, Bash)

Containerization (Docker, Kubernetes)

Leading engineering teams

Education

Background in Computer Science or Computer Engineering

Tools

HPC job scheduling systems (Slurm, Torque, LSF)

Cloud computing platforms (AWS, Azure, Google Cloud)

Storage systems (SANs, NAS)

Agile development methodologies

Job description

You will be part of the dynamic team responsible for building resilient network infrastructure using cutting-edge technologies such as cloud-based and software-defined networking e.g. SD-WAN, ACI and NSX. You must have a good understanding of IT infrastructure systems, and knowledge in the latest networking technologies and platforms. You will be a technical specialist in a team, and must be keen to take on new challenges and keep abreast with rapidly evolving technology landscape.

Role

• We are seeking an experienced HPC Staff Engineer to join our team, responsible for managing and optimizing our HPC infrastructure platform. The successful candidate will have a deep understanding of HPC systems, architectures and technologies, as well as experience with managing large-scale computing environments. The role will involve designing, implementing and maintaining the HPC infrastructure platform, ensuring high availability, scalability and performance.

Responsibilities

• Lead a team to deliver resilient, scalable and secure HPC platform, including compute nodes, storage systems, networks and job scheduling systems.
• Lead, design, implement and manage the HPC infrastructure platform to meet organisational needs.
• Design and implement storage solutions for HPC workloads to ensure efficient data storage and retrieval.
• Design and implement high-performance networking solutions, including InfiniBand, Ethernet, and other interconnects.
• Plan and manage HPC resource capacity, including forecasting, procurement and deployment of new hardware and software.
• Manage HPC clusters, including optimizing, monitoring and troubleshooting cluster performance, as well as managing job scheduling and resource allocation.
• Ensure the security and compliance of the HPC infrastructure platform, including managing access controls, implementing security patches, and conducting regular security checks.
• Collaborate with stakeholders like data scientists and developers to optimize application performance on the HPC platform and provide technical support on using the HPC infrastructure platform.

Requirements (Minimum Qualifications)

• Background in Computer Science, Computer Engineering, or a related field.
• 8+ years of experience in managing HPC systems, including experience with Linux, Unix, or other operating systems.
• Strong knowledge of HPC architectures, including clusters, grids, and clouds.
• Experience with HPC job scheduling systems, such as Slurm, Torque and LSF.
• Strong understanding of storage systems, including SANs, NAS, and object storage.
• Experience with high-performance networking, including InfiniBand, Ethernet, and other interconnects.
• Experience with cloud computing platforms, such as AWS, Azure, or Google Cloud.
• Experience with scripting languages, such as Python, Perl, or Bash.
• Experience with containerization (Docker, Kubernetes) and proficient in a range of complementary technologies, including Knative, Run:AI, Grafana, Prometheus, Kyverno, ArgoCD, Rancher, NVIDIA BCM and knowledge of NVIDIA Superpod architecture.
• Experience in leading engineering teams.

Nice to Have

• Certifications in NVIDIA AI Infrastructure and Operations, and Certified Kubernetes Administrator.
• Experience with machine learning or deep learning frameworks, such as TensorFlow or PyTorch.
• Familiarity with agile development methodologies and version control systems, such as Git.

Why join us?

• The work is purposeful and meaningful
• You will work with the best engineers
• We work with modern technologies and tech stacks
• We have excellent engineering culture and work-life balance
• We aspire to engineering and operational excellence
• We empower to innovate
• We grow together as a family

As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.