Platform Engineer

Epergne Solutions; Singapore; Presencial; SGD 20.000 - 28.000; Jornada completa

Descripción de la vacante

Epergne Solutions is seeking a skilled data platform engineer to manage Databricks environments across AWS and Azure. The role emphasizes platform configuration, security setup, automation, and seamless CI/CD pipelines.

You will implement Unity Catalog, RBAC, and access controls, integrate with Azure AD, and build automation using Python, PowerShell, and Terraform. Strong focus on reliability, monitoring, and secure data access.

Formación

• Proficient with Databricks platform setup and Unity Catalog.
• Experience implementing RBAC, Databricks APIs, and automation.
• Strong scripting in Python/PowerShell and IaC with Terraform.

Responsabilidades

• Manage and support Databricks environments across AWS and Azure.
• Configure security, access controls, and platform automation.
• Build CI/CD pipelines and tests with Pytest for quality.

Conocimientos

Automation scripting

CI/CD

Security configuration

DevOps practices

Herramientas

Databricks Platform

Unity Catalog

RBAC

Databricks APIs

Service Principals

Azure Active Directory

Terraform

Azure DevOps

Python

PowerShell

Pytest

AWS

Azure

Descripción del empleo

Role Summary:

We are looking for a skilled engineer to manage and support Databricks environments across AWS and Azure. The role focuses on platform configuration, security setup, automation, and continuous integration/deployment pipelines.

Location: Noida/Gurgaon/Hyderabad/Bangalore/Pune

Core Skills & Responsibilities:

• Databricks Platform:
• Work with Databricks Unity Catalog to organize and manage data assets.
• Set up access controls (RBAC) to manage user and group permissions.
• Use Databricks APIs and Service Principals for automation and secure access.
• Integrate with Azure Active Directory (AD) groups.
• Networking & Cloud Connectivity:
• Configure and troubleshoot network connectivity (NCC) on both AWS and Azure.
• Monitor systems and services for performance and issues.
• Programming & Automation:
• Write scripts using Python and PowerShell for automation tasks.
• Use Terraform to define and deploy infrastructure as code.
• DevOps & Testing:
• Build and manage deployment pipelines using Azure DevOps.
• Write unit tests and integration tests using Pytest to ensure code quality and stability.