Senior Data Engineer | Databricks & PySpark Expert

NCS Pte Ltd; Hong Kong; On-site; HKD 640,000 - 980,000; Full time

Job summary

NCS Pte Ltd is seeking a senior data engineer to design, develop, and operate scalable data pipelines on the Databricks platform, from ingestion through consumption. You will optimize Spark jobs, implement robust error handling, and collaborate with data architects to ensure data quality and production reliability.

The role requires 8+ years in data engineering, hands-on Databricks experience, and a track record of modernizing legacy code and pipelines.

Qualifications

• 8+ years in data engineering or related roles
• 2–3 years with Databricks
• Refactoring legacy code to modern frameworks
• Building production data pipelines at scale
• Experience with multiple data sources/formats
• Experience in agile environments
• Databricks certifications are mandatory

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Data Modeling

Python

CI/CD

Git

ETL/ELT

Data Pipelines

Education

Bachelor's in Computer Science/Engineering

Tools

Databricks Notebooks

Cluster Management

Job description

NCS Pte Ltd is seeking a senior data engineer to design, develop, and operate scalable data pipelines on the Databricks platform, from ingestion through consumption. You will optimize Spark jobs, implement robust error handling, and collaborate with data architects to ensure data quality and production reliability.

The role requires 8+ years in data engineering, hands-on Databricks experience, and a track record of modernizing legacy code and pipelines.