Principal Engineer, AI & Data Engineering, Data Solutioning, xData

HTX (Home Team Science & Technology Agency); Singapore; On-site; SGD 180,000 - 260,000; Full time

Job summary

HTX (Home Team Science & Technology Agency) in Singapore is seeking a Principal Engineer (AI & Data Engineering) to architect and lead scalable, intelligent HTX AI Data Platform initiatives powering Home Team AI products.

You will design end-to-end data lifecycles, govern data quality, and drive data integration, pipelines, security and governance across multiple systems, teams and cloud environments.

Qualifications

• Tertiary qualification in Computer Science, Information Technology or related disciplines.

Responsibilities

• AI Data Architecture: develop and implement a cohesive data strategy across Home Teams.
• Form capabilities development roadmaps for AI and Data Engineering.
• Data Integration: oversee integration of data from various sources.
• Data Pipeline Development: build and manage data pipelines for AI products and applications.
• Data Quality Assurance: establish data quality, validation, governance.
• Review AI Data Platform & Data Engineering requirements for delivery with high quality.
• Performance Optimization: optimize data processing for complex AI models.
• Security: ensure data security and regulatory compliance.
• Innovation: stay updated with the latest AI Data Engineering technologies and best practices.
• Guide the team to deliver AI Platform capabilities within timeline and governance.
• Support DDs with xData and collaborate with AI teams to resolve challenges.
• Oversee AI Data Platform and Engineer systems and development of AI Products.
• Review audit findings and propagate lessons learned.
• Facilitate data sharing and data consumption requirements and design solutions.

Skills

SQL

Python

Distributed systems

Data modelling

AI Data Engineering

Tools

Hadoop ecosystem

Cloud data services

Spark

Kafka

Flink

Airflow

Distributed SQL

Job description

What The Role Is

The Home Team Science and Technology Agency (HTX) is a statutory board under the Ministry of Home Affairs (MHA) which aims to pioneer innovation solutions and develop world class science and technology capabilities to transform and empower the Home Team in delivering safety and security for Singapore.

What The Role Is

The Home Team Science and Technology Agency (HTX) is a statutory board under the Ministry of Home Affairs (MHA) which aims to pioneer innovation solutions and develop world class science and technology capabilities to transform and empower the Home Team in delivering safety and security for Singapore.

The Principal Engineer (AI & Data Engineering) is responsible to architect and lead the development of scalable, intelligent and robust HTX AI Data Platform & Engineering that power cutting-edge AI solutions in HTX and Home Teams. This role plays a pivotal role to designing and optimizing the end-to-end lifecycle, from ingestion to consumption, ensuring that AI models are fuelled by high-quality, well-governed, and rich contextual data. This role drives the following AI & Data Engineering initiatives:

• Home Teams Data Platforms and System Integrations
• AI Data Platform & Engineering that comprises of multiple systems in different phases.
  
  

What You Will Be Working On

• AI Data Architecture: develop and implement a cohesive data strategy across Home Teams that aligns with organisation’s AI goals.
• Provide guidance as SME to formulate capabilities development roadmaps for the AI and Data Engineering domain areas.
• Data Integration: Oversees the integration of data from various sources, ensuring consistency, accuracy and accessibility.
• Data Pipeline Development: Build and manage efficient data pipelines to process large volumes of data for AI products and applications.
• Data Quality Assurance: Establish protocols for data quality, validation, and governance.
• Review all enterprise AI Data Platform (including Data Governance and compliance with IM requirements) & Data Engineering requirements to deliver AI Product to ensure technical feasibility, completeness and comprehensiveness with high quality.
• Performance Optimization: Optimize data processing performance for complex AI models.
• Security: Ensure data security and compliance with relevant regulations and standards. Including AI Governance and Security
• Innovation: Stay updated with the latest AI Data Engineering technologies and best practices, advocating for the adoption within HTX.
• Guide the team to deliver the AI Platforms and Data Engineering capabilities within stipulated timeline, compliant with governance and security guidelines/standards.
• Support DDs in xData and work closely with AI Data Engineering, AI Product teams, AI Enablers and PMCs to resolve and overcome any programme and project department challenges
• Assumes oversight of AI Data Platform and Engineer systems and development of AI Products to ensure continuous ops capabilities, including technology refresh, preventive maintenance, and corrective maintenance work.
• Review audit findings and recommendations, and propagate the lesson learnt and corrective actions across the PMTs.
• Facilitate the formulation of data sharing and data consumption requirements, design, implementation and integration of data solution for the identified project.

What We Are Looking For

• Tertiary qualification in Computer Science, Information Technology or related disciplines.
• Minimum 8 years of relevant working experience including a minimum of 3 year in a leadership position
• Strong interest in technologies and innovation, particularly in AI Data Engineering, solutioning and data management.
• Strong planning and project management skills. PMP or equivalent certification would be an advantage.
• Able to work independently and within a team.
• Facilitation skills, planning skills, problem-solving skills, organising capabilities and foresight to drive projects.
• Good interpersonal and communications skills for internal/external stakeholders’ engagement.
• Experience in building government systems that meet IM8 policies would be an advantage.

Technical Skills

• Able to design and implement a data system solution.
• Has professional experience with Hadoop ecosystem would be an advantage.
• Has experience in building solutions on any cloud provider e.g. AWS, Azure, GCP.
• Strong knowledge in networking and system security would be an advantage
• Possess strong knowledge in:
• Data modelling (OLTP, OLAP, dimensional modelling).
• Cloud data services (AWS Redshift, GCP BigQuery, Azure Synapse/Microsoft Fabric, Snowflake, Databricks, etc.)
• Big data technologies (Spark, Kafka, Flink, etc.)
• ETL/ELT frameworks and tools (Airflow, Talend, Informatica, dbt, etc.)
• Hands-on experience with SQL, Python and distributed systems.
  
  All new hires are appointed on a two-year contract in the first instance and will be assessed and considered for permanent tenure over time, based on performance.
  
  As part of the shortlisting process for this role, you may be required to complete a medical declaration and/or undergo further assessment.
  
  All applicants will be updated on the status of their applications within 4 weeks upon closing of the advertisement.