Databricks Data Engineer: Scalable Cloud Pipelines & AI

Accenture; Metro Manila; On-site; PHP 600,000 - 1,200,000; Full time

Job summary

Accenture is seeking an experienced Databricks Data Engineer to design, build, and optimize enterprise data solutions that support analytics, reporting, ML, and Generative AI use cases.

You will develop scalable ETL and ELT pipelines using Databricks, Python, and PySpark, working with Delta Lake, Auto Loader, and Delta Live Tables. Collaborate with teams to enable secure data sharing and BI integrations.

Qualifications

• Must have hands-on experience with Databricks data engineering workflows and cloud-based data platforms.
• Proficient in Python and PySpark for building scalable ETL/ELT pipelines.
• Strong understanding of data governance, security, and CI/CD practices.

Responsibilities

• Design, develop, and maintain scalable data solutions for analytics, reporting, ML, and Generative AI use cases.
• Build ETL/ELT pipelines using Databricks, Delta Lake, Auto Loader, and Delta Live Tables.
• Write, test, and maintain high-quality Python code; implement data transformation and validation with PySpark.
• Create modular Databricks functions for data transformation and PII masking.
• Develop reusable components for notebooks and Delta Live Tables pipelines.
• Configure Unity Catalog and secure data sharing via Delta Sharing; ensure access control and logging.
• Connect Databricks with BI tools (Power BI, Tableau, Looker) via connectors and Unity Catalog security controls.

Skills

Databricks

Python

PySpark

CI/CD

Data modeling

Tools

Delta Lake

Auto Loader

Delta Live Tables

Unity Catalog

Databricks Asset Bundles

Job description

Accenture is seeking an experienced Databricks Data Engineer to design, build, and optimize enterprise data solutions that support analytics, reporting, ML, and Generative AI use cases.

You will develop scalable ETL and ELT pipelines using Databricks, Python, and PySpark, working with Delta Lake, Auto Loader, and Delta Live Tables. Collaborate with teams to enable secure data sharing and BI integrations.