Data Engineer: Real-Time Pipelines & AI-Driven Analytics

NCS Group; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

NCS Group in Singapore is seeking a Data Engineer to develop and maintain scalable data pipelines, integrating multiple data sources and ensuring high-quality data for analytics, reporting, and machine learning.

You will collaborate with analytics, product and infrastructure leaders to advance our data platform, enforce governance, monitoring and reliability, and explore Azure, Databricks and related platforms.

Qualifications

• Fresh graduates welcome; wide range of data engineering experience allowed.
• Experience designing data solutions with data modeling.
• Hands-on with Talend, PySpark and SQL.
• Experience orchestrating pipelines with Talend, ADF, Airflow or similar tools.

Responsibilities

• Develop and maintain ETL pipelines for centralized storage systems.
• Integrate data from databases, APIs, log files, streaming platforms, and external providers.
• Develop data transformation routines to clean, normalize, and aggregate data.
• Apply data processing techniques to handle complex or inconsistent datasets.
• Contribute to frameworks and best practices for code development and deployment.
• Implement data governance in alignment with company standards.
• Partner with analytics and product leaders to design and operationalize pipelines.
• Collaborate with infrastructure leaders to advance cloud-based data platforms.
• Explore new tools and techniques leveraging Azure, Databricks, or related platforms.
• Monitor data pipelines to detect and resolve issues promptly.
• Develop monitoring tools, alerts, and automated error-handling mechanisms.

Skills

ETL design

Data modeling

PySpark

SQL proficiency

Data governance

Tools

Talend

ADF

Airflow

Databricks

Job description

NCS Group in Singapore is seeking a Data Engineer to develop and maintain scalable data pipelines, integrating multiple data sources and ensuring high-quality data for analytics, reporting, and machine learning.

You will collaborate with analytics, product and infrastructure leaders to advance our data platform, enforce governance, monitoring and reliability, and explore Azure, Databricks and related platforms.