Senior Data Engineer (Big Data Processing)

Centre for Strategic Infocomm Technologies (CSIT); Singapore; On-site; SGD 70,000 - 90,000; Full time

Benefits offered by this job

Work-life balance

Excellent engineering culture

Use of modern technologies

Job summary

A national security-focused technology organization in Singapore is seeking a Senior Data Engineer to develop and maintain high-performance data pipelines. The ideal candidate will have at least 5 years of experience in data engineering and a bachelor's degree in computer science. This role offers meaningful work, collaboration with talented professionals, and a commitment to engineering excellence.

Qualifications

• At least 5 years of experience in data engineering focusing on large-scale data pipelines.
• Proven ability to write optimized ETL code for large datasets.
• Effective communication of technical details.

Responsibilities

• Design and build scalable, robust, and maintainable data pipelines.
• Collaborate with product managers and stakeholders.
• Optimize performance of large-scale data pipelines.
• Ensure data integrity and quality through robust design.

Skills

Data pipeline design and maintenance

ETL optimization

Scala or Java proficiency

Knowledge of Spark, Kafka, Hadoop

Education

Bachelor's degree in computer science or related field

Tools

Spark

Kafka

Hadoop

Elastic Stack

Kudu

Job description

Join us to apply for the Senior Data Engineer (Big Data Processing) role at Centre for Strategic Infocomm Technologies (CSIT).

CSIT develops products to advance Singapore's national security interests, including counter-terrorism and computer network defence. We seek talented senior data engineers to lead and develop mission-critical products that identify, analyse, and investigate threats.

Role

As a senior data engineer, you will contribute to the development and maintenance of high-performance data pipelines and systems related to national security. Your work will involve handling complex technical projects to collect, parse, and process large datasets, transforming them into valuable insights. Join us to leverage cutting-edge technologies to protect the nation.

Responsibilities

• Design and build scalable, robust, and maintainable data pipelines using advanced platforms and technologies.
• Collaborate with product managers, engineering managers, and stakeholders to deliver impactful data products.
• Optimize performance of large-scale data pipelines for low latency, high throughput, and reliability.
• Ensure data integrity, quality, and governance through robust design and operational monitoring.
• Troubleshoot and resolve complex issues in critical data pipelines.
• Implement best practices in data engineering, including testing, orchestration, and monitoring.
• Lead technical discussions to shape the future of data products.
• Mentor junior engineers and foster a strong data engineering culture.

Requirements

• Bachelor's degree in computer science or related field.
• At least 5 years of experience in data engineering, focusing on large-scale data pipelines.
• Proven ability to write optimized ETL code for large datasets.
• Proficiency in Scala or Java.
• Experience with Spark, Kafka, Hadoop, Elastic stack, Kudu.
• Strong understanding of modern data architectures and modeling paradigms.
• Effective communication of technical details.
• Good interpersonal, analytical, and problem-solving skills in a dynamic environment.

Why Join Us?

• Purposeful and meaningful work.
• Work with talented, driven professionals.
• Use modern technologies and stacks.
• Excellent engineering culture and work-life balance.
• Aim for engineering and operational excellence.
• Encourage innovation.

Note: As CSIT is under the Ministry of Defence (Singapore), only Singapore Citizens are eligible.

Additional Details

• Seniority level: Mid-Senior level
• Employment type: Full-time
• Job function: Information Technology
• Industries: IT Services and Consulting