Data Engineer

RSK CFSE PTE. LTD.; Singapore; On-site; SGD 60,000 - 80,000; Full time

Job summary

A leading data solutions provider in Singapore is seeking a Data Engineer to manage high-volume data flows and IoT-specific analytics. You will work on developing scalable data pipelines and ensure data quality for innovative solutions in the IoT domain. The role requires a strong foundation in data engineering, programming skills in Python and SQL, and knowledge of Azure technologies. Join us to support operational excellence across industries.

Qualifications

• Bachelor’s degree in Computer Science or a related field.
• Experience or interest in IoT and data systems.
• Strong programming skills in Python and SQL.

Responsibilities

• Design and maintain scalable data pipelines for IoT data.
• Implement data ingestion workflows and integrate with platforms.
• Ensure data quality through validation and monitoring processes.

Skills

Data engineering

IoT technologies

SQL Programming

Python Programming

Data ingestion workflows

Azure Data Factory

ETL processes

Education

Bachelor's degree in Computer Science or related field

Tools

Azure

Power BI

Hadoop

Kafka

Job description

Overview

We are seeking a Data Engineer with experience or interest in IoT technologies and cloud-based data engineering to join our team. This role blends the management of high-volume data flows and IoT-specific analytics with general data engineering practices to deliver robust and scalable data solutions. The ideal candidate will balance technical skills and domain knowledge, enabling data-driven insights for utility operations, customer services, and infrastructure optimisation initiatives.

Key Responsibilities

• Design, develop, and maintain scalable and efficient data pipelines and ETL processes for IoT and enterprise data systems.
• Implement data ingestion workflows from IoT devices and integrate with enterprise platforms using Azure Data Factory or similar tools.
• Ensure data quality through validation, cleansing, and monitoring processes to address issues such as missing data, duplicates, and inconsistencies.
• Define data attributes and formats for IoT device and network data to support seamless integration with existing systems and standards.
• Optimise data storage solutions in Azure Data Lake Storage (or equivalent) for structured and unstructured data.
• Develop APIs and data interfaces for real-time or near-real-time data transfer between IoT components and enterprise platforms.
• Apply advanced analytics techniques to IoT data for performance monitoring, usage profiling, and network management.
• Leverage BI tools (e.g., Power BI) to enable business intelligence and operational insights.
• Implement robust data security and privacy measures, ensuring compliance with relevant regulations.
• Collaborate with cross-functional teams to gather requirements and deliver high-quality, documented solutions.

Required Skills & Qualifications

• Bachelor’s degree in Computer Science, Information Technology, or a related field. Advanced degrees or certifications are advantageous.
• Academic or industrial experience in data engineering, including SQL Databases and cloud platforms (Azure, AWS, or GCP).
• Experience or interest in IoT technologies and data systems.
• Proficiency in data ingestion tools such as Azure Data Factory and ETL processes.
• Strong programming skills in Python, SQL, and one or more of Java or Scala.
• Familiarity with big data technologies (e.g., Hadoop, Kafka) and enterprise service buses (ESB).
• Knowledge of data management systems and integration with enterprise applications.
• Understanding of operational data flows, business cycles, and regulatory requirements.
• This position open to fresh graduates.

Preferred Skills & Qualifications

• Familiarity with additional Azure ecosystem tools (e.g., Synapse Analytics, Event Hub, Stream Analytics).
• Experience with APIs, data interfaces, and integrating IoT systems with enterprise data platforms.
• Relevant certifications in Microsoft Azure or other recognised credentials.
• Knowledge of DevOps practices and CI/CD pipelines (e.g., Azure DevOps).
• Familiarity with containerisation technologies such as Docker.
• Background in implementing Change Data Capture (CDC) designs and scalable data architectures.

Personal Attributes

• Excellent communication and collaboration skills.
• Strong analytical and problem-solving mindset.
• Proactive approach to continuous professional development.
• Ability to work effectively in dynamic, fast-paced environments.

This position offers an opportunity to work at the intersection of IoT data systems and modern cloud engineering, supporting innovation and operational excellence across industries.