Senior Data Engineer

Government Technology Agency (GovTech); Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

Housing & Development Board (HDB) is seeking a data architect to design scalable cloud-native data platforms and lead data lakehouse initiatives in Singapore. You will collaborate with stakeholders to translate business needs into robust technical specifications and ensure secure, compliant data operations.

You will drive cloud migrations, implement IaC with Terraform, and mentor junior engineers while shaping HDB’s data strategy and platform evolution.

Qualifications

• Bachelor’s degree in CS/IT or related field.
• 3+ years in data systems architecture and production pipelines.
• Strong grasp of cloud, IaC, microservices, and data governance.

Responsibilities

• Design scalable data architectures on cloud platforms with high availability.
• Lead development of Data Lakehouse solutions.
• Translate business requirements into technical specifications.
• Build and optimize ETL/ELT pipelines and data workflows.
• Implement automated data quality checks and monitoring.
• Oversee multi-cloud migration strategies and cloud-native data solutions.

Skills

SQL

Python

Spark

Cloud & Data Platforms

ETL/ELT

Education

Bachelor's degree in Computer Science or related field

Tools

Apache Spark

Apache Kafka

Airflow

AWS

Terraform

AWS SageMaker

Job description

What the role is

The mission of Housing & Development Board (HDB) is to provide affordable, quality housing and a great living environment where communities thrive. To achieve its mission, HDB aims to be data-driven to the core and adopt evidence-based decision making in developing better policies, improving service delivery, and optimising operations.

What you will be working on

• Data Pipeline Infrastructure & Architecture Design and implement scalable data architectures on cloud data platforms with high availability, security, and performance
• Lead development of Data Lakehouse solutions
• Collaborate with stakeholders to understand requirements and translate them into technical specifications
• Pipeline Development & Optimisation Build and maintain robust ETL/ELT pipelines using modern data engineering tools and frameworks
• Optimise data processing workflows for performance, cost-effectiveness, and reliability
• Implement automated data quality checks and monitoring systems to ensure data integrity
• Data Systems Architecting & Solutioning Design and architect comprehensive cloud-native Data & AI solutions aligned with business objectives and technical requirements
• Lead cloud migration strategies and oversee implementation of complex multi-cloud environments
• Drive innovation through integration of Data & AI capabilities into HDB’s Data & AI platform product architectures
• Conduct technical assessments and recommend modernised approaches using cloud native technologies
• Maintain architectural documentation
• Cloud Platform Operations Leverage Cloud Native Services to build and manage data infrastructure
• Implement infrastructure as code practices using Terraform
• Ensure compliance with security standards and data governance policies
• Technical Leadership & Collaboration Mentor junior data engineers and provide technical guidance on complex challenges
• Participate in architectural reviews and contribute to data strategy evolution

What we are looking for

• Bachelor’s degree in computer science, Information Technology, Computer Engineering, or related field
• Minimum 3 years of relevant experience in data systems architecture, data systems integration, and data pipeline setup at production scale
• Good understanding of cloud computing principles including infrastructure as code, containerisation, microservices architecture, cloud security frameworks, identity and access management, network architecture, and distributed systems
• Proven ability to translate business requirements into technical solutions
• Excellent communication skills for presenting complex concepts to diverse audiences
• Experience with cloud security frameworks, compliance requirements, and risk management
• Experience in data domains (e.g. DataOps, Data Lakehouse) and AI/ML Domains (e.g. MLOps, LLMOps)
• Strong Knowledge and Hands-on experience with SQL, Python and Apache Spark
• Hands-on experience with Apache Kafka, Airflow, or similar technologies
• Proficiency in Amazon Web Services (AWS) services
• Relevant cloud certifications (e.g. AWS Solutions Architect Professional, AWS Data Engineer Associate) would be an advantage
• Experience with Data & AI cloud-native services (e.g. Amazon SageMaker Unified Studio, Amazon Quick Suite, AWS S3, AWS Glue, AWS Lake Formation, AWS Bedrock, AWS Agent Core)
• Familiarity with serverless computing, edge computing, and IoT architectures would be an advantage.
• Experience with machine learning operations (MLOps) and ML model deployment pipelines
• Knowledge of data governance frameworks and metadata management tools
• Familiarity with data visualisation tools and business intelligence platforms

http://jobs.careers.gov.sg The Singapore Public Service plays a key role in the economic growth, progress and stability of Singapore by formulating and implementing government policies, as well as providing key public services. Whether you are a fresh graduate joining the workforce or an experienced professional, the Singapore Public Service offers a great variety of job opportunities for you. The work in the Public Service can be broadly categorised into the following sectors: Economic, Social, Security & External Relations, and Administration & Corporate Development. Be part of the team that shapes the future of Singapore.