Data Engineer: Scalable Pipelines & AI Analytics

NCS; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

Data Engineer at NCS in Singapore will design and maintain scalable data pipelines, integrating diverse data sources and ensuring high-quality data for analytics and ML tasks. You will work with analytics, product, and infrastructure teams to advance our data platform with governance and reliability as core principles.

The role involves implementing ETL/ELT processes, collaborating on cloud-based data platforms, and leveraging tools like Talend, PySpark, and Databricks to deliver robust data

Qualifications

• Experience in data engineering with ETL/ELT pipelines.
• Hands-on with Talend, PySpark and SQL.
• Experience with batch and real-time data processing.
• Familiarity with DevOps, Git workflows and CI/CD.

Responsibilities

• Develop and maintain ETL pipelines for centralized data storage systems.
• Integrate data from databases, APIs, log files, streaming platforms and external providers.
• Develop data transformation routines to clean, normalize, and aggregate data.
• Apply data processing techniques to handle complex or inconsistent datasets.
• Contribute to frameworks and best practices for code development and deployment.
• Implement data governance in alignment with company standards.
• Partner with analytics and product leaders to design and operationalize pipelines.
• Collaborate with infrastructure leaders to advance cloud-based data platforms.
• Explore new tools and techniques leveraging Azure, Databricks, or related platforms.
• Monitor data pipelines to detect and resolve issues promptly.
• Develop monitoring tools, alerts, and automated error-handling mechanisms.

Skills

Hands-on data engineering

SQL proficiency

Python/PySpark

Data governance

DevOps/CI/CD

Education

Bachelor's degree in Computer Science/IT

Data Engineering certifications

Tools

Talend

ADF

Airflow

Databricks

Git

SQL/DB

Job description

Data Engineer at NCS in Singapore will design and maintain scalable data pipelines, integrating diverse data sources and ensuring high-quality data for analytics and ML tasks. You will work with analytics, product, and infrastructure teams to advance our data platform with governance and reliability as core principles.

The role involves implementing ETL/ELT processes, collaborating on cloud-based data platforms, and leveraging tools like Talend, PySpark, and Databricks to deliver robust data