Data Engineer: Real-Time Pipelines on Azure & Databricks

re-zoo-me; Singapore; Hybrid; SGD 90,000 - 130,000; Full time

Job summary

NCS is hiring a Data Engineer in Singapore to develop scalable data pipelines and ensure high-quality data processing for analytics, reporting, and ML tasks. You will collaborate with analytics, product, and infrastructure teams to advance our data platform while maintaining governance and reliability.

You will design and operate ETL/ELT pipelines, integrate diverse data sources, and implement robust data processing and monitoring capabilities across Azure/Databricks ecosystems.

Qualifications

• Open to a wide range of data engineering experience levels, including fresh graduates.
• Experience designing data solutions including data modelling.
• Hands-on experience with data processing jobs using SQL and PySpark.
• Experience orchestrating data pipelines with Talend, ADF, Airflow or similar tools.
• Experience with both batch and real-time data processing.
• Proficiency in SQL across multiple data systems (e.g., SQL DB, Cloudera).
• Understanding of DevOps tools and CI/CD or MLOps pipelines.

Responsibilities

• Develop and maintain ETL pipelines for centralized data storage systems.
• Integrate data from databases, APIs, log files, streaming platforms, and external providers.
• Create data transformation routines to clean, normalize, and aggregate data.
• Apply data processing techniques to handle complex datasets.
• Contribute to frameworks and best practices for code development and deployment.
• Implement data governance in alignment with company standards.
• Partner with analytics and product leaders to design pipelines.
• Collaborate with infrastructure leaders to advance cloud-based data platforms.
• Explore tools and techniques leveraging Azure, Databricks, or related platforms.
• Monitor pipelines to detect and resolve issues promptly.
• Develop monitoring tools, alerts, and automated error-handling mechanisms.

Skills

Data modelling

ETL pipelines

SQL

PySpark

Cloud data platforms

DevOps & CI/CD

Data governance

Collaboration

Tools

Talend

ADF

Airflow

Databricks

Azure

Job description

NCS is hiring a Data Engineer in Singapore to develop scalable data pipelines and ensure high-quality data processing for analytics, reporting, and ML tasks. You will collaborate with analytics, product, and infrastructure teams to advance our data platform while maintaining governance and reliability.

You will design and operate ETL/ELT pipelines, integrate diverse data sources, and implement robust data processing and monitoring capabilities across Azure/Databricks ecosystems.