Senior Data Engineer - Cloud Data Pipelines & Lakehouse

ACTIVATE INTERACTIVE PTE LTD; Singapore; Vor Ort; SGD 120.000 - 180.000; Vollzeit

Zusammenfassung

Activate Interactive Pte Ltd in Singapore is seeking a Senior Data Engineer to design, build, productionise and operate trusted data pipelines on the SWDA data platform using AWS and Databricks for Singapore Government Agency projects.

This is a fixed-term contract role with a 1-year engagement. You will provide technical leadership across ingestion, transformation, quality, lineage and governance to ensure data remains dependable for analytics, reporting and ML workloads.

Qualifikationen

• Strong Python, PySpark and SQL capability.
• Hands-on experience with Databricks, Apache Spark and Delta Lake for production-scale data engineering.
• Hands-on AWS data engineering experience with a relevant mix of S3

Aufgaben

• Lead design and implementation of batch and streaming data pipelines across AWS and Databricks.
• Design Bronze, Silver and Gold data layers using Delta Lake patterns and data products.
• Implement reliable ingestion from databases, files, APIs and event streams using various patterns.
• Establish schema enforcement, data contracts, automated validation and data quality checks.
• Build parameterised workflows and CI/CD controls across environments.

Kenntnisse

Python

PySpark

SQL

Tools

Databricks

Apache Spark

Delta Lake

AWS

Jobbeschreibung

Activate Interactive Pte Ltd in Singapore is seeking a Senior Data Engineer to design, build, productionise and operate trusted data pipelines on the SWDA data platform using AWS and Databricks for Singapore Government Agency projects.

This is a fixed-term contract role with a 1-year engagement. You will provide technical leadership across ingestion, transformation, quality, lineage and governance to ensure data remains dependable for analytics, reporting and ML workloads.