Databricks Data Engineer — Build Scalable Cloud Pipelines

NCS

Singapore

On-site

SGD 90,000 - 130,000

Full time

9 hours ago
Be an early applicant
Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Benefits offered by this job

Competitive compensation
Professional development support
Collaborative environment
Impactful data projects

Job summary

NCS is seeking a Data Engineer to design, develop, and maintain scalable data pipelines on Databricks and cloud platforms, integrating diverse data sources and supporting analytics, reporting and ML workloads.

You will collaborate with analytics, product, and infrastructure teams to enhance the data platform, implement governance, monitoring, reliability, and contribute to dashboards, scorecards and data visualizations.

Qualifications

  • 3+ years of data engineering experience with scalable pipelines.
  • Experience with PySpark, Spark SQL and Databricks.
  • Experience with Azure cloud data processing.
  • Proficient in SQL with window functions and performance optimization.
  • Understanding of DevOps practices, Git workflows, and CI/CD pipelines.
  • Familiarity with Scrum and working in Agile teams.
  • Experience with streaming technologies (e.g., Kafka, Kinesis).
  • Knowledge of data governance and data quality practices.

Responsibilities

  • Develop and maintain ETL pipelines for centralized data storage systems (e.g. Delta Lake).
  • Integrate data from databases, APIs, log files, streaming platforms, and external providers.
  • Design data transformations to clean, normalize, and aggregate data.
  • Collaborate with analytics, product, and infrastructure teams to enhance data platforms.
  • Implement data governance, monitoring, and reliability practices.
  • Develop dashboards, reports, scorecards, and visualizations.
  • Monitor pipelines and optimize performance and scheduling.

Skills

Databricks
PySpark
SQL
Airflow
Azure
Data modelling
Streaming
DevOps
Git
Scrum

Tools

Databricks notebooks
Azure Data Factory
Airflow

Job description

NCS is seeking a Data Engineer to design, develop, and maintain scalable data pipelines on Databricks and cloud platforms, integrating diverse data sources and supporting analytics, reporting and ML workloads.

You will collaborate with analytics, product, and infrastructure teams to enhance the data platform, implement governance, monitoring, reliability, and contribute to dashboards, scorecards and data visualizations.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Databricks Data Engineer for Azure Pipelines
Databricks Data Engineer for Azure Pipelines

NCS Group • Singapore

On-site
SGD 90,000 - 130,000
Competitive compensation
Professional development support
Collaborative environment
Data Engineer (Databricks)
Data Engineer (Databricks)

BASIL TECHNOLOGIES PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
Databricks Data Engineer — Build Scalable Pipelines & Dashboards
Databricks Data Engineer — Build Scalable Pipelines & Dashboards

Visa Hunt • Singapore

On-site
SGD 90,000 - 150,000
Databricks Data Engineer: Build Scalable Pipelines
Databricks Data Engineer: Build Scalable Pipelines

PERSOL SINGAPORE PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
Data Engineer (Databricks) - Scalable Cloud Pipelines
Data Engineer (Databricks) - Scalable Cloud Pipelines

PERCEPT SOLUTIONS PTE. LTD. • Singapore

On-site
SGD 80,000 - 110,000
Senior Data Engineer: Scalable Pipelines & ML Ops
Senior Data Engineer: Scalable Pipelines & ML Ops

SINGAPORE AIRLINES LIMITED • Singapore

On-site
SGD 80,000 - 120,000
Databricks Engineer
Databricks Engineer

K2 PARTNERING SOLUTIONS PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
Data Engineer (Databricks)
Data Engineer (Databricks)

Percept Solutions Pte Ltd • Singapore

On-site
SGD 90,000 - 120,000
Databricks Data Engineer: Azure Pipelines & Real-Time Analytics
Databricks Data Engineer: Azure Pipelines & Real-Time Analytics

BASIL TECHNOLOGIES PTE. LTD. • Singapore

On-site
SGD 90,000 - 130,000
#EG Data Engineer (Databricks)
#EG Data Engineer (Databricks)

NCS • Singapore

On-site
SGD 90,000 - 130,000
Competitive compensation
Professional development support
Collaborative environment
+1