Data Platform Engineer: Impactful Public Service & Growth

Government Technology Agency (GovTech); Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

National Library Board seeks a data engineer to design scalable data architectures and manage data platforms. You will collaborate with architects and vendors to implement databases, data lakes, and integrated data pipelines for analytics and reporting.

The role requires 2-5 years of data management experience, proficiency in SQL and Python, and familiarity with AWS data services and data governance. On-site work at ESR BizPark @ Chai Chee in Singapore.

Qualifications

• 2-5 years of relevant technical working experience with data management, RDBMS and ETL.
• Experience in data migration projects including migration strategy design, data profiling and quality assessment.

Responsibilities

• Data Architecture Design: collaborate with solution architects and vendors to design scalable data architectures.
• Data Management: set up and manage databases and data lake, optimize queries and ensure data integrity and security.
• Data Integration: integrate data from different sources for unified analysis and reporting.
• Data Transformation: perform masking, aggregations, joins, and filtering as required.
• Data Migration: plan, test, and deploy end-to-end migrations to new data platform.
• Data Quality & Governance: implement quality checks and governance practices.
• Monitoring & Troubleshooting: monitor pipelines and resolve data ingestion/storage issues.
• Documentation: document data engineering processes and configurations.
• Support Data Platform Operation: develop features and improve pipelines.

Skills

SQL

Python

ETL

RDBMS

Data modelling

Data pipeline development

Education

Relevant IT qualifications or equivalent experience

Tools

AWS Platform Architecture

S3

Data Lakehouse

Apache Iceberg

Glue

DataBrew

Lambda

Athena

Databricks

Snowflake

Airflow

Qlik Sense

Tableau

Job description

National Library Board seeks a data engineer to design scalable data architectures and manage data platforms. You will collaborate with architects and vendors to implement databases, data lakes, and integrated data pipelines for analytics and reporting.

The role requires 2-5 years of data management experience, proficiency in SQL and Python, and familiarity with AWS data services and data governance. On-site work at ESR BizPark @ Chai Chee in Singapore.