Senior Data Engineer: Cloud Lakehouse & Production Pipelines

Activate Interactive Pte Ltd.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Benefits offered by this job

Flexible work arrangement

Learning & development budget (SHRI 25

Job summary

Activate Interactive Pte Ltd is seeking a Senior Data Engineer in Singapore to design, build, productionise and operate trusted data pipelines on the SWDA platform using AWS and Databricks. You will provide technical leadership across ingestion, transformation, quality, lineage and orchestration to support analytics, reporting and ML workloads.

You will lead data pipeline architecture, lakehouse patterns, and data product engineering across batch and streaming data, while implementing data

Qualifications

• Strong Python, PySpark and SQL capability with distributed processing and automated testing.
• Hands‑on experience with Databricks, Apache Spark and Delta Lake for production data engineering.
• AWS data engineering experience with S3, Glue, Lake Formation, IAM, KMS, Lambda, Step Functions, EventBridge, CloudWatch, Redshift, MSK/Kinesis.
• Experience designing lakehouse or data‑lake architectures with layered data patterns and reusable datasets.
• Experience implementing incremental ingestion, change data capture and data quality in production pipelines.
• Familiarity with CI/CD, Terraform and environment promotion controls.

Responsibilities

• Lead design and delivery of batch and streaming data pipelines across AWS and Databricks.
• Design Bronze, Silver and Gold data layers with Delta Lake or equivalent patterns; develop data models and data products.
• Implement reliable ingestion from databases, files, APIs and event streams with various processing patterns.
• Establish data contracts, schema validation and data quality checks across pipelines.
• Build workflows using Databricks Workflows or Lakeflow; integrate tests and infrastructure as code; enable CI/CD.
• Implement metadata, lineage and governance with Unity Catalog, AWS Glue Data Catalog or Lake Formation.
• Define dashboards, alerts and runbooks for pipeline health and data quality; troubleshoot root causes.
• Optimise Spark/SQL workloads and cost efficiency; tune cluster configuration and data partitioning.
• Apply least-privilege security, encryption and audit logging across pipelines.
• Review designs and code; mentor engineers and promote reusable components.
• Collaborate with data owners, analysts, data scientists and governance teams to define data specifications.
• Document architecture decisions, data models and operating procedures; transfer knowledge to the team.

Skills

Python

PySpark

SQL

Databricks

Apache Spark

AWS

Data modeling

Delta Lake

Data pipelines

CI/CD

Tools

Databricks Unity Catalog

Airflow

Terraform

Kinesis

Glue

Unity Catalog

Job description

Activate Interactive Pte Ltd is seeking a Senior Data Engineer in Singapore to design, build, productionise and operate trusted data pipelines on the SWDA platform using AWS and Databricks. You will provide technical leadership across ingestion, transformation, quality, lineage and orchestration to support analytics, reporting and ML workloads.

You will lead data pipeline architecture, lakehouse patterns, and data product engineering across batch and streaming data, while implementing data