You will be part of a high-performing and multi-disciplinary research division in NCSS that conducts a range of research initiatives that impacts policy and operations in Singapore’s social service sector. NCSS has multiple operations systems and is currently implementing a new Data Platform where data will be aggregated and transformed to answer strategic business questions.
1/ The Data Engineer will perform a crucial role in designing, building, and maintaining robust infrastructure and systems across NCSS digital products.
Key Responsibilities
Data Infrastructure Support
- Assist in designing and developing data pipelines and architectures to collect, process, harmonize and store data from various source systems across NCSS digital products
- Support the building of data pipelines that integrate data from multiple NCSS platforms and services
- Help maintain data lakes and database infrastructure to support analytical, reporting, and AI workloads across the NCSS ecosystem
Data Quality and Monitoring
- Implement data validation, cleansing, and normalisation processes under supervision to ensure data quality and integrity
- Monitor data pipelines and systems to identify potential issues and performance bottlenecks 2
- Assist in maintaining data governance frameworks that support compliance and data security requirements
System Maintenance and Documentation
- Support the maintenance of data infrastructure supporting NCSS digital products
- Assist in troubleshooting and resolving data-related issues under guidance from senior team members
- Create and maintain documentation of data engineering processes and system configurations
Stakeholder Collaboration
- Work closely with senior data engineers, product teams, analysts, and stakeholders across NCSS to understand business data requirements and translate them into technical specifications and scalable solutions
- Design, develop and deploy data tables, visualisation and marts for business reporting and other purposes
Professional Development
- Stay current with emerging technologies and trends in data engineering through training and mentorship
- Participate in continuous learning opportunities to develop technical skills and domain knowledge
- Contribute to process improvements and suggest enhancements to existing data systems
- Participate in knowledge sharing sessions and contribute to team learning initiatives
Behaviours Needed to Succeed
- Behaviours Needed to Succeed Personal Competencies: Open-minded, flexible and adaptive Self-driven and takes the initiative Skills & Knowledge: Technical Skills
Skills & Knowledge: Technical Skills
- Proficiency in at least one programming language such as Python, Java, or Scala for data processing and scripting
- Strong analytical and problem-solving skills with attention to detail Multi-tasking under time pressure in a fast-paced environment Good communication skills Work both independently and as a member of a team.
- Basic knowledge of database systems, both relational and non-relational, and their query languages (SQL knowledge essential)
- Understanding of data modelling and schema design principles
- Familiarity with data integration and ETL (Extract, Transform, Load) concepts and processes
- Basic experience with version control systems such as Git Cloud and Platform Knowledge
- Basic familiarity with cloud platforms, preferably AWS services such as S3, EC2, and RDS
- Exposure to big data technologies and frameworks such as Spark or similar platforms
- Experience with Databricks and implementing batch/real-time data pipelines Understanding of data governance policies, access controls, and security best practices in government environments.