Senior/ Data Engineer

st engineering mission software & services pte. ltd.; Singapore; On-site; SGD 120,000 - 150,000; Full time

Job summary

st engineering mission software & services pte. ltd. in Singapore is seeking a Senior Data Engineer to design, implement and maintain data flow channels and processing systems for batch and real-time analytics, scalable and secure.

You will collaborate with data scientists and stakeholders, build ETL pipelines, data warehouses, and governance practices, and contribute to pre-sales support and post-sales data solutions.

Qualifications

• Shall have at least three (3) years' experience in building and optimising data pipelines, architecture and datasets using DI/ETL technology (Informatica, Talend etc).
• Shall have experience in supporting data transformation, data structures, metadata, dependency and workload management, big data technologies (e.g., Sparks, Hadoop, Hive).
• Shall have the following skillsets: Data Wrangling, Data Visualization, DBMS, SQL, PythonExperience in multiple data source support (flat files, SQL database, SAP database, PostgreSQL database, unstructured data not limited to text, documents, images, digitalized video, digitalised audio, sensordata) would be advantageous.
• Experience in these products/tools would be advantageous: MS Access (Front-end), SharePoint (Back-end), Power BI (Visualisation), Kubernetes, Docker/Podman, Microservices Architecture, DevSecOps Methodology

Responsibilities

• Work with stakeholders including customers, partners and colleagues on data-related technical issues and support their data infrastructure needs;
• Work closely with data scientists to solicit data requirements to support modeling works
• Design, develop, document, manage and maintain data models, ETL processes, data warehouse, data management and pipeline solutions for large volume of structured/unstructured data from disparate sources and with different latencies (e.g. on-demand, batch, real-time, near-real-time);
• Define, monitor and report SLAs for data pipelines and data products;
• Understand data security and governance standards or requirements to implement solutions that ensure adherence to these standards or meet such requirements;
• Drive/execute data quality assurance practices; and
• Support data management solutions pre-sales initiatives, proposal development and provide post-sales support.

Skills

Data pipelines

ETL/DI tools

Big data technologies

SQL

Python

Data visualization

Data governance

Tools

MS Access

SharePoint

Power BI

Kubernetes

Docker/Podman

Microservices Architecture

DevSecOps

Job description

About our Line of Business – Mission Software & Services

OurMission Software & Servicesbusiness provides leading-edge mission critical command, control, and communications (C3) systems with secured IT infrastructure and managed services. We support our client’s innovation journey through design thinking, analytics, and AI-enabled decision support with our full suite of cloud computing solutions. We provide intelligent, actionable insights and sustainable solutions to our valued partners in diverse industries including defence, government, and commercial sectors.

Together, We Can Make A Significant Impact

We are seeking a Senior Data Engineer that supports the design, implementation and maintenance of data flow channels and data processing systems that support the collection, storage, batch and real-time processing, and analysis of information in a scalable, repeatable and secure manner. The Senior Data Engineer focuses on defining optimal solutions to data collection, processing and warehousing. He / She designs, codes and tests data systems and works on implementing those into the internal infrastructure.

Be Part of Our Success

• Work with stakeholders including customers, partners and colleagues on data-related technical issues and support their data infrastructure needs;
• Work closely with data scientists to solicit data requirements to support modeling works
• Design, develop, document, manage and maintain data models, ETL processes, data warehouse, data management and pipeline solutions for large volume of structured/unstructured data from disparate sources and with different latencies (e.g. on-demand, batch, real-time, near-real-time);
• Define, monitor and report SLAs for data pipelines and data products;
• Understand data security and governance standards or requirements to implement solutions that ensure adherence to these standards or meet such requirements;
• Drive/execute data quality assurance practices; and
• Support data management solutions pre-sales initiatives, proposal development and provide post-sales support.

Qualities We Value

• Shall have at least three (3) years' experience in building and optimising data pipelines, architecture and datasets using DI/ETL technology (Informatica, Talend etc).
• Shall have experience in supporting data transformation, data structures, metadata, dependency and workload management, big data technologies (e.g., Sparks, Hadoop, Hive).
• Shall have the following skillsets: Data Wrangling, Data Visualization, DBMS, SQL, PythonExperience in multiple data source support (flat files, SQL database, SAP database, PostgreSQL database, unstructured data not limited to text, documents, images, digitalized video, digitalised audio, sensordata) would be advantageous.
• Experience in these products/tools would be advantageous: MS Access (Front-end), SharePoint (Back-end), Power BI (Visualisation), Kubernetes, Docker/Podman, Microservices Architecture, DevSecOps Methodology

Our Commitment That Goes Beyond the Norm

• An environment where you will be working on cutting-edge technologies and architecture.
• Safe space where diverse perspectives are valued, and everyone’s unique contributions are celebrated.
• Meaningful work and projects that make a difference in people’s lives.
• A fun, passionate and collaborative workplace.

Work locations: Changi, Paya Lebar, Tengah