Data Engineer (Big Data Processing)

Centre for Strategic Infocomm Technologies (CSIT); Singapore; Sur place; SGD 120 000 - 180 000; Plein temps

Résumé du poste

Centre for Strategic Infocomm Technologies (CSIT) is seeking a senior data engineer to lead the design and maintenance of mission-critical data analytics systems for national security. You will develop high-performance data pipelines, process large datasets, and transform them into actionable intelligence.

Join CSIT to work with cutting-edge technologies, collaborate with multidisciplinary teams, and help protect national interests through robust data engineering practices and AI-enabled

Qualifications

• Degree in Computer Science or an equivalent qualification.
• Strong foundations in programming with Scala or Java.
• Hands-on experience with Spark, Kafka, Hadoop, Elastic Stack and Kudu.
• Familiarity with AI-assisted development tools and concepts, exposure to agentic AI systems would be a plus.
• Excellent communication of technical details and strong problem-solving skills in a dynamic environment.

Responsabilités

• Design and build scalable, robust data pipelines ingesting crucial data.
• Collaborate with product managers and stakeholders to deliver impactful data products.
• Optimize large-scale pipelines for low latency and high throughput.
• Ensure data integrity, quality and governance with robust monitoring.
• Build and experiment with Agentic AI systems and LLM workflows.
• Troubleshoot complex issues in critical data pipelines.
• Apply data engineering best practices including testing and orchestration.
• Participate in technical discussions to shape future data products.

Connaissances

Scala

Java

Analytical thinking

Formation

Computer Science or equivalent

Outils

Spark

Kafka

Hadoop

Elastic Stack

Kudu

Description du poste

CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of use-cases, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented senior data engineers to lead and build mission-critical products that identify, analyse and investigate threats.

Role

As a data engineer in a team that is responsible for mission-critical data analytics systems, you will contribute to the development and maintenance of high-performance data pipelines and systems related to national security. You will be involved in complex technical projects to collect, parse and process large datasets with the aim of turning them into useful information and insights. Join us to seize the opportunity to use cutting-edge technologies to protect the nation.

Responsibilities

• Design and build data pipelines that are scalable, robust and maintainable to ingest crucial data using cutting-edge platforms and technologies
• Work with product managers, engineering managers and key stakeholders to deliver impactful data products that meet our business needs
• Optimise performance of large-scale data pipelines for low latency, high throughput and high reliability
• Ensure data integrity, quality and governance through robust design and operational monitoring
• Build and experiment with Agentic AI systems (e.g. multi-step autonomous agents, tool-using LLM workflows)
• Troubleshoot and resolve complex issues in critical data pipelines
• Implement data engineering best practices, including testing, orchestration and monitoring of data pipelines
• Participate in technical discussions with the team and key stakeholders to shape the future of our data products

Requirements

• A degree or professional qualification in Computer Science or equivalent
• Strong foundations in programming languages such as Scala or Java
• Familiarity with the following technologies: Spark, Kafka, Hadoop, Elastic stack, Kudu
• Familiarity with AI-assisted development tools and concepts, exposure to agentic AI systems would be a plus
• Able to communicate technical details effectively and clearly
• Good interpersonal, analytical and problem-solving skills to get things done in a dynamic environment

As CSIT is an agency under the Ministry of Defence (Singapore), only Singapore Citizens will be considered.

Why join us?

• The work is purposeful and meaningful
• You will get to work with talented and driven people
• We work with modern technologies and tech stacks
• We have excellent engineering culture and work-life balance
• We aspire for engineering and operational excellence
• We empower to innovate

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans.