Databricks Data Engineer: Pipelines & Governance

Aryan-Solutions-Pte.-Ltd.

Singapore

On-site

SGD 120,000 - 180,000

Full time

3 days ago

Be an early applicant

Application generator

Stand out for this role — generate a tailored resume and cover letter in about a minute.

Get past ATS filters

Job summary

Aryan-Solutions-Pte.-Ltd. is seeking a senior Data Engineer with Databricks expertise to design catalogues, implement data pipelines and governance in a cloud data platform. You will optimize Spark workloads, manage CI/CD for Databricks artifacts and ensure observability across data flows.

The role requires at least 5 years in data engineering, 3 years with Databricks, and hands-on experience with Delta Lake, Unity Catalog, and PySpark to deliver scalable data solutions.

Qualifications

Hands-on experience with Unity Catalog for catalogue design, access control and lineage.
Extensive Delta Lake/Delta Live Tables for pipeline orchestration and data formats.
Deep knowledge of Databricks SQL and cluster/workspace administration.
Experience with Databricks Asset Bundles and Databricks Repos for CI/CD.
Strong PySpark or Spark SQL for large-scale transformations.
Observability via system tables, logs, billing/usage and query history.
Minimum 5 years in Data Eng / Data Platform Eng roles; minimum 3 years with Databricks for pipelines and governance.

Skills

Unity Catalog

Data lineage

Delta Live Tables

Databricks SQL

CI/CD Databricks

Asset Bundles

Databricks Repos

PySpark

Observability

SQL

Python

Data modeling

Dimensional design

Star/Snowflake schemas

CI/CD pipelines

Terraform

Cloud (AWS/Azure/GCP)

Tools

Delta Lake

Lakeflow

Terraform

Azure DevOps

GitHub Actions

GitLab CI

Job description

The role requires at least 5 years in data engineering, 3 years with Databricks, and hands-on experience with Delta Lake, Unity Catalog, and PySpark to deliver scalable data solutions.

Get your free, confidential resume review.

or drag and drop your file here.