Big Data Engineer, Genomics & DataOps (Hybrid Cloud)

National University of Singapore

Singapore

On-site

SGD 90,000 - 160,000

Full time

5 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

The National University of Singapore is seeking a skilled Big Data Engineer to join the Genomics and Data Analytics Core (GeDaC) to support petabyte-scale data logistics and data-centric infrastructure. You will focus on data ingestion, IaC, and governance while enabling Nextflow/Kubernetes pipelines in a hybrid cloud setting.

You will collaborate with a small, senior technical team and report to a Facility Head experienced in DataOps.

Qualifications

2+ years in Data Engineering, Backend Development, or DevOps.
Experience with commercial cloud infrastructure (AWS preferred).
Strong Python-based data tooling and automation experience.
Proficiency in SQL (PostgreSQL/Aurora) and object storage (S3-like).
Linux/Unix environment proficiency.

Responsibilities

Data Ingestion & Logistics: automate data ingress from sequencing instruments to hybrid storage.
IaC: manage AWS resources via CloudFormation or Terraform ensuring reproducibility and security.
Governance: implement audit logs, access controls, and lineage tracking for regulatory needs.
Hybrid Cloud Synchronization: manage data movement between on-prem HPC and AWS for cost/performance balance.
Pipeline Integration: coordinate with HPC engineers for Nextflow/Kubernetes pipelines; feed data lake/warehouse.
Database Management: maintain SQL/NoSQL metadata stores with low-latency APIs.