Databricks Data Engineer: End-to-End Pipelines & Governance

COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD.; Singapore; On-site; SGD 90,000 - 170,000; Full time

Job summary

Cognizant Technology Solutions Asia Pacific PTE. LTD. seeks a senior data engineer to design, build, and operate end-to-end data pipelines on Databricks and Snowflake, following medallion patterns.

You will configure workspaces, implement data governance, and set up CI/CD and IaC for deployment, while collaborating with client stakeholders and platform architects to ensure compliant, scalable data delivery across government/regulated environments.

Qualifications

• Strong SQL and Python (PySpark) for data engineering.
• Data modeling — dimensional design, star/snowflake schemas.
• CI/CD pipelines for data engineering workflows.
• Infrastructure‑as‑code (Terraform preferred) for provisioning cloud data resources.
• Hands‑on experience on at least one hyperscaler (AWS/Azure/GCP).
• Understanding of data security/compliance for government/public‑sector environments.

Responsibilities

• Design, build, and operate end‑to‑end data pipelines on Databricks/Snowflake using medallion patterns.
• Configure and administer workspaces/accounts per SDP reference architecture.
• Implement data governance: catalogu e/schema design, RBAC, data masking, lineage.
• Set up CI/CD and IaC for pipeline deployment (dev → test → prod).
• Configure monitoring, telemetry, and audit logging for observability and security.
• Support UAT, integration testing, and parallel‑run validation during migration/go‑live.
• Produce handover documentation for agency operations teams.
• Collaborate with client, agency stakeholders, and Principal solution architects.

Skills

Strong SQL

Python (PySpark)

Data modeling

CI/CD pipelines

Infrastructure‑as‑code

Hyperscaler knowledge

Data security/compliance

Tools

Databricks Unity Catalog

Delta Live Tables

Delta Lake

Databricks SQL

Databricks Repos

DABs

Job description

Cognizant Technology Solutions Asia Pacific PTE. LTD. seeks a senior data engineer to design, build, and operate end-to-end data pipelines on Databricks and Snowflake, following medallion patterns.

You will configure workspaces, implement data governance, and set up CI/CD and IaC for deployment, while collaborating with client stakeholders and platform architects to ensure compliant, scalable data delivery across government/regulated environments.