Senior/ Data Engineer - DSC/EZ

ST Engineering Mission Software & Services Pte Ltd; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A leading engineering firm in Singapore seeks a skilled Data Engineer to support data flow channels and processing systems. This role involves collaborating with stakeholders, designing data models, and ensuring data security standards. Candidates should possess proficiency in data modelling, programming languages like Java and Python, and experience with technologies such as Hadoop and Spark. Join us to make a significant impact through innovative data solutions.

Qualifications

• In-depth technical knowledge in data modelling and pipelines.
• Technical expertise in Java, C/C++, Python, Scala, and SQL.
• Experience in big data technologies like Hadoop and Spark.

Responsibilities

• Support design, implementation, and maintenance of data flow channels.
• Work with stakeholders on data-related technical issues.
• Design and develop data models and ETL processes.
• Monitor and report SLAs for data pipelines.

Skills

Data Modelling

Data Pipelines

OLAP

Data Ingestion & Integration technologies

Query Optimisation

Java

C/C++

Python

Scala

SQL

Hadoop

Spark

Hive

HBase

Job description

About our Line of Business – Mission Software & Services

Our Mission Software & Services business provides leading-edge mission critical command, control, and communications (C3) systems with secured IT infrastructure and managed services. We support our client’s innovation journey through design thinking, analytics, and AI-enabled decision support with our full suite of cloud computing solutions. We provide intelligent, actionable insights and sustainable solutions to our valued partners in diverse industries including defence, government, and commercial sectors.

Together, We Can Make A Significant Impact

The Data Engineer supports the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable and secure manner. The Data Engineer focuses on defining optimal solutions to data collection, processing and warehousing. He / She designs, codes and tests data systems and works on implementing those into the internal infrastructure.

Be Part of Our Success

• Work with stakeholders including customers, partners and colleagues on data-related technical issues and support their data infrastructure needs;

• Work closely with data scientists to solicit data requirements to support modeling works

• Design, develop, document, manage and maintain data models, ETL processes, data warehouse, data management and pipeline solutions for large volume of structured/unstructured data from disparate sources and with different latencies (e.g. on-demand, batch, real-time, near-real-time);

• Define, monitor and report SLAs for data pipelines and data products;

• Understand data security and governance standards or requirements to implement solutions that ensure adherence to these standards or meet such requirements;

• Drive/execute data quality assurance practices; and

• Support data management solutions pre-sales initiatives, proposal development and provide post-sales support.

Qualities We Value

• In-depth technical knowledge in:

• Data Modelling;

• Data Pipelines;

• OLAP;

• Data Ingestion & Integration techonlogies;

• Query Optimisation

• Technical expertise in:

• Java, C/C++, Python, Scala, SQL etc.

• Big data technologies e.g. Hadoop, Spark, Hive, HBase etc.

• Experience in master data management, data governance, data lifecycle management etc.;

• Experience in designing, documenting, implementing and supporting data management solutions;

• Experience in using software engineering best practices in development, programming, testing, version control etc.;

• Knowledge of data privacy and security assurance;