Databricks Platform Engineer - AWS/Azure Automation & CI/CD

Epergne Solutions; Singapore; On-site; SGD 20,000 - 28,000; Full time

Job summary

Epergne Solutions is seeking a skilled data platform engineer to manage Databricks environments across AWS and Azure. The role emphasizes platform configuration, security setup, automation, and seamless CI/CD pipelines.

You will implement Unity Catalog, RBAC, and access controls, integrate with Azure AD, and build automation using Python, PowerShell, and Terraform. Strong focus on reliability, monitoring, and secure data access.

Qualifications

• Proficient with Databricks platform setup and Unity Catalog.
• Experience implementing RBAC, Databricks APIs, and automation.
• Strong scripting in Python/PowerShell and IaC with Terraform.

Responsibilities

• Manage and support Databricks environments across AWS and Azure.
• Configure security, access controls, and platform automation.
• Build CI/CD pipelines and tests with Pytest for quality.

Skills

Automation scripting

CI/CD

Security configuration

DevOps practices

Tools

Databricks Platform

Unity Catalog

RBAC

Databricks APIs

Service Principals

Azure Active Directory

Terraform

Azure DevOps

Python

PowerShell

Pytest

AWS

Azure

Job description

Epergne Solutions is seeking a skilled data platform engineer to manage Databricks environments across AWS and Azure. The role emphasizes platform configuration, security setup, automation, and seamless CI/CD pipelines.

You will implement Unity Catalog, RBAC, and access controls, integrate with Azure AD, and build automation using Python, PowerShell, and Terraform. Strong focus on reliability, monitoring, and secure data access.