Databricks Platform Engineer: Data Pipelines & DW Expert

Accenture Inc.; Metro Manila; On-site; PHP 700,000 - 1,200,000; Full time

Job summary

Accenture Inc. is seeking a Data Engineer to design, develop and maintain data solutions for data generation, collection, and processing. You will build scalable ETL/ELT pipelines using Databricks, Delta Lake, and PySpark, ensuring data quality and enabling BI and analytics across cloud platforms.

Responsibilities include implementing Delta Sharing, configuring Unity Catalog, and deploying pipelines via CI/CD. Collaboration with stakeholders to monitor KPIs and SLA compliance is essential.

Qualifications

• Advanced knowledge of ETL/ELT design and data pipelines.
• Proficiency in Python programming for data processing and validation.
• Hands-on PySpark experience for large-scale data transformations.
• Experience with cloud platforms: AWS, GCP, or Azure.
• Experience with Databricks Delta Lake and Delta Sharing.
• Ability to build modular data transformation functions and automate pipelines.

Responsibilities

• Develop scalable ETL/ELT pipelines using Databricks technologies (Delta Lake, Auto Loader, DLT).
• Implement data quality checks and validation logic across pipelines.
• Configure Unity Catalog, access controls, and auditing for data safety.
• Create SQL dashboards and BI connectors (ODBC/JDBC) to monitor KPIs.
• Collaborate with stakeholders to enable Delta Sharing internally and externally.
• Package pipelines for CI/CD deployment using GitHub or GitLab.

Skills

Databricks

Python

PySpark

Delta Lake

Auto Loader

DLT

Unity Catalog

Cloud Platforms

Data Warehousing

CI/CD

Tools

Databricks

Power BI

Tableau

Looker

Unity Catalog

ODBC/JDBC connectors

GitHub/GitLab

Job description

Accenture Inc. is seeking a Data Engineer to design, develop and maintain data solutions for data generation, collection, and processing. You will build scalable ETL/ELT pipelines using Databricks, Delta Lake, and PySpark, ensuring data quality and enabling BI and analytics across cloud platforms.

Responsibilities include implementing Delta Sharing, configuring Unity Catalog, and deploying pipelines via CI/CD. Collaboration with stakeholders to monitor KPIs and SLA compliance is essential.