Databricks Data Engineer for Azure Pipelines

NCS Group; Singapore; On-site; SGD 90,000 - 130,000; Full time

Benefits offered by this job

Competitive compensation

Professional development support

Collaborative environment

Job summary

NCS Group is a leading AI Tech Services company in Asia Pacific. We are seeking a Data Engineer to design, develop, and maintain scalable data pipelines on Databricks and cloud platforms, integrating diverse sources to support analytics and ML workloads.

The role involves collaborating with analytics, product and infrastructure teams, implementing governance and monitoring, and advancing cloud-based data platforms using Azure and related tools. 3+ years’ experience preferred.

Qualifications

• 3+ years of experience building scalable data pipelines.
• Hands-on with PySpark, Spark SQL and Databricks notebooks.
• Experience with real-time and batch data processing.
• Strong SQL skills including window functions.
• Familiarity with Scrum and Agile teams.
• Exposure to Azure cloud data platforms and governance.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Databricks and cloud platforms.
• Integrate data from databases, APIs, log files and streaming platforms.
• Develop data transformation routines to clean and aggregate data.
• Implement governance, monitoring, and reliability practices.
• Collaborate with analytics, product, and infrastructure teams.

Skills

PySpark

Databricks

SQL

Azure

Airflow

Kafka

Data modeling

Python

Scrum/Agile

Tools

Databricks notebooks

Azure Data Factory

Azure Databricks

Delta Lake

Spark

Git

Job description

NCS Group is a leading AI Tech Services company in Asia Pacific. We are seeking a Data Engineer to design, develop, and maintain scalable data pipelines on Databricks and cloud platforms, integrating diverse sources to support analytics and ML workloads.

The role involves collaborating with analytics, product and infrastructure teams, implementing governance and monitoring, and advancing cloud-based data platforms using Azure and related tools. 3+ years’ experience preferred.