Databricks Data Engineer: Delta Lake, PySpark & ETL Expert

8000 Accenture Inc Company; Cebu City; On-site; PHP 900,000 - 1,300,000; Full time

Job summary

Accenture is hiring for a Data Engineer to design, build, and maintain data solutions that generate, collect, and process data. You will develop scalable ETL/ELT pipelines using Databricks, Delta Lake, and PySpark, while ensuring data quality and security across multiple cloud environments.

Required skills include Python programming, Databricks tooling, and experience with Unity Catalog, Delta Sharing, and BI tool integrations.

Qualifications

• Develop high-quality, scalable ETL/ELT pipelines using Databricks technologies and Delta Lake
• Strong Python programming and debugging skills
• Hands-on experience with PySpark data transformations and validation logic
• Proficiency in at least one cloud platform: AWS, GCP, or Azure
• Create modular dbx functions for transformation, masking, and validation across pipelines
• Implement ingestion patterns with Auto Loader and schema evolution for structured data
• Build secure and observable DLT pipelines with Delta Sharing and lineage tracking
• Configure Unity Catalog for catalogs, schemas, masking and audit logging
• Enable secure data access across domains and workspaces via Unity Catalog External Locations
• Experience with data sharing, BI tool integration and KPI dashboards in Databricks

Responsibilities

• Develop ETL/ELT pipelines using modern Databricks tooling
• Write clean Python code with robust debugging
• Implement PySpark transformations and data quality checks
• Work with AWS/GCP/Azure cloud platforms for data solutions
• Create reusable dbx functions for transformations and masking
• Manage data ingestion with Auto Loader and schema evolution
• Build DLT pipelines with Delta sharing and lineage
• Configure Unity Catalog for security and masking
• Enable cross-domain data access via Unity Catalog features
• Integrate Databricks with BI tools and build KPI dashboards

Skills

Python

Databricks

PySpark

Cloud platforms (AWS/GCP/Azure)

SQL

Data modeling

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

dbt

Informatica

Talend

Matillion

Fivetran

Power BI

Tableau

Looker

Job description

Accenture is hiring for a Data Engineer to design, build, and maintain data solutions that generate, collect, and process data. You will develop scalable ETL/ELT pipelines using Databricks, Delta Lake, and PySpark, while ensuring data quality and security across multiple cloud environments.

Required skills include Python programming, Databricks tooling, and experience with Unity Catalog, Delta Sharing, and BI tool integrations.