Big Data Engineer for Genomics AI Data Factory

NATIONAL UNIVERSITY OF SINGAPORE; Singapore; On-site; SGD 80,000 - 100,000; Full time

Job summary

A leading educational institution in Singapore is seeking a skilled Big Data Engineer to join their Cancer Science Institute. The role involves architecting data automation, managing AWS infrastructures, and ensuring data compliance for extensive cancer research projects. Candidates should have a Bachelor’s degree in Computer Science and at least 2 years of experience in Data Engineering. Proficiency in Python and Infrastructure as Code tools is critical, along with experience in cloud environments. The position offers a dynamic team atmosphere focused on cutting-edge data analytics.

Qualifications

• 2+ years of experience in Data Engineering, Backend Development, or DevOps.
• Demonstrable experience working with commercial cloud infrastructure (AWS preferred).
• Experience with workflow managers like Nextflow or container orchestration via Kubernetes.

Responsibilities

• Architect and maintain robust automation for ingesting raw data.
• Manage and deploy AWS resources using AWS CloudFormation.
• Implement the technical controls for data governance.
• Manage the lifecycle of data moving between on-premise HPC and AWS S3.
• Work closely with the Senior HPC Engineer for data processing pipelines.
• Maintain SQL and NoSQL databases for file metadata.

Skills

Python (data tooling, automation scripts)

Infrastructure as Code (IaC)

SQL (PostgreSQL/Aurora)

AWS cloud infrastructure

Linux/Unix environments

Education

Bachelor’s degree in Computer Science

Tools

AWS CloudFormation

Terraform

Job description

A leading educational institution in Singapore is seeking a skilled Big Data Engineer to join their Cancer Science Institute. The role involves architecting data automation, managing AWS infrastructures, and ensuring data compliance for extensive cancer research projects. Candidates should have a Bachelor’s degree in Computer Science and at least 2 years of experience in Data Engineering. Proficiency in Python and Infrastructure as Code tools is critical, along with experience in cloud environments. The position offers a dynamic team atmosphere focused on cutting-edge data analytics.