Databricks Platform Engineer: ETL, Delta Lake & PySpark

Accenture; Philippines; On-site; PHP 600,000 - 1,800,000; Full time

Job summary

Accenture in Philippines is seeking a data engineer to design, develop, and maintain scalable data pipelines using Databricks, Delta Lake, Auto Loader, and DLT. You will implement ETL processes, ensure data quality, and enable secure data access across environments.

You'll work with PySpark, Python, SQL dashboards, and BI connectors (Power BI/Tableau/Looker) to monitor KPIs and SLA health. Experience with Unity Catalog, Delta Sharing, and CI/CD workflows in GitHub or GitLab is highly valued.

Qualifications

• Strong Python and PySpark programming skills.
• Hands-on Databricks experience with Delta Lake, Auto Loader, and DLT.
• Proficient in at least one cloud platform: AWS, GCP, or Azure.
• Experience building scalable ETL/ELT pipelines and data quality checks.

Responsibilities

• Design, develop and maintain data pipelines for generation, collection and processing.
• Implement ETL/ELT processes across systems and ensure data quality.
• Build secure, observable DLT pipelines with Bronze/Silver/Gold medallion zoning.
• Configure Unity Catalog for catalogs, schemas, access control and masking.
• Enable cross-domain data access via Unity Catalog External Locations and lineage.
• Create SQL dashboards in Databricks to monitor KPIs and SLAs.
• Integrate BI tools (Power BI/Tableau/Looker) via optimized connectors.
• Package and deploy pipelines using Databricks Asset Bundles in CI/CD.
• Troubleshoot and optimize jobs using Photon engine and serverless compute.

Skills

Python

PySpark

Databricks

SQL

ETL/ELT

Data modeling

Performance tuning

Cloud platforms

CI/CD

Education

Databricks Certified Professional

Tools

Delta Lake

Auto Loader

DLT

Unity Catalog

Delta Sharing

ODBC/JDBC connectors

GitHub/GitLab CI/CD

MLflow

Databricks Asset Bundles

Job description

Accenture in Philippines is seeking a data engineer to design, develop, and maintain scalable data pipelines using Databricks, Delta Lake, Auto Loader, and DLT. You will implement ETL processes, ensure data quality, and enable secure data access across environments.

You'll work with PySpark, Python, SQL dashboards, and BI connectors (Power BI/Tableau/Looker) to monitor KPIs and SLA health. Experience with Unity Catalog, Delta Sharing, and CI/CD workflows in GitHub or GitLab is highly valued.