Senior Data Engineer — Lakehouse Pipelines Lead

NEXBRIDGE RECRUITMENT PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

NEXBRIDGE RECRUITMENT PTE. LTD. is seeking an experienced Data Engineer to lead design and implementation of scalable batch and streaming data pipelines on AWS and Databricks. You will develop Bronze-Silver-Gold data layers, enforce data contracts, and drive data governance across interconnected teams.

The role requires hands-on expertise with Databricks, Spark, Delta Lake and cloud data services, plus strong coding in Python and SQL to deliver reliable data products and dashboards.

Qualifications

• 6 years of relevant data or software engineering experience with production data pipelines
• Hands-on design and operation of cloud-based data platforms (e.g. AWS)
• Strong Python, PySpark and SQL capabilities including distributed processing and automated testing
• Experience with Databricks, Apache Spark and Delta Lake in production
• Experience with data lake architectures, data contracts and data governance

Responsibilities

• Lead design and implementation of batch and streaming pipelines ingesting diverse data
• Design Bronze, Silver and Gold data layers using Delta Lake
• Implement ingestion from databases, files, APIs and event streams
• Establish data quality checks, contracts, lineage and metadata management
• Build parameterised workflows using Databricks Workflows or Lakeflow
• Define observability dashboards, alerts and runbooks for pipeline health and data quality
• Optimize Spark/SQL workloads and cost efficiency on AWS/Databricks
• Apply security controls and least-privilege access for data sharing
• Mentor engineers and promote reusable data components
• Collaborate with data owners, governance and platform teams to translate needs into specs

Skills

Python

PySpark

SQL

Databricks

Apache Spark

Data modeling

Leadership

Education

Bachelor's degree in Computer Science/Software Engineering/Data Engineering or related

Tools

Databricks

Delta Lake

Lake Formation

Delta Live Tables

Structured Streaming

Job description

NEXBRIDGE RECRUITMENT PTE. LTD. is seeking an experienced Data Engineer to lead design and implementation of scalable batch and streaming data pipelines on AWS and Databricks. You will develop Bronze-Silver-Gold data layers, enforce data contracts, and drive data governance across interconnected teams.

The role requires hands-on expertise with Databricks, Spark, Delta Lake and cloud data services, plus strong coding in Python and SQL to deliver reliable data products and dashboards.