Data Engineer – Databricks | Taguig City

Private Advertiser; Taguig; On-site; PHP 800,000 - 1,400,000; Full time

Job summary

Private Advertiser is seeking an experienced Data Engineer specializing in Databricks to design, develop, and maintain robust data pipelines and ETL solutions. You will work closely with multiple teams to enhance data accessibility, quality, and processing efficiency, providing expert guidance on complex data engineering challenges.

The role requires strong hands-on Databricks proficiency, Delta Live Tables, Unity Catalog, PySpark, SQL, and Azure Data Factory, with a focus on scalable data

Qualifications

• 5+ years of experience in data engineering with hands-on Databricks experience.
• Strong knowledge of Databricks Unified Data Analytics Platform.
• Experience with Delta Live Tables (DLT), Auto Loader, and Unity Catalog.
• Proficiency in Python/PySpark and SQL.
• Experience with Azure Data Factory and data warehousing concepts.

Responsibilities

• Develop, optimize, and maintain data pipelines and ETL processes.
• Work with Databricks to build and manage scalable data solutions.
• Monitor and troubleshoot data quality and pipeline issues.
• Implement corrective actions to ensure reliable data processing.
• Collaborate with cross-functional teams on data engineering initiatives.
• Provide technical solutions and guidance to the team.
• Participate in key technical decisions and contribute to data projects.
• Document data processes, workflows, and technical solutions.
• Serve as a subject matter expert in Databricks and data engineering.

Skills

Databricks

PySpark

Python

SQL

Azure Data Factory

Delta Live Tables

Auto Loader

Data Modeling

ETL

Data Warehousing

5+ years experience

Tools

Databricks Unity Catalog

Job description

About the role

We are looking for an experienced Data Engineer with strong expertise in Databricks to design, develop, and maintain data solutions, pipelines, and ETL processes. The role will work closely with multiple teams to improve data accessibility, quality, and processing efficiency while providing technical expertise and solutions to complex data engineering requirements.

Key responsibilities

• Develop, optimize, and maintain data pipelines and ETL processes.

• Work with Databricks to build and manage scalable data solutions.

• Monitor and troubleshoot data quality and pipeline issues.

• Implement corrective actions to ensure reliable data processing.

• Collaborate with cross-functional teams on data engineering initiatives.

• Provide technical solutions and guidance to the team.

• Participate in key technical decisions and contribute to data-related projects.

• Document data processes, workflows, and technical solutions.

• Serve as a subject matter expert in Databricks and data engineering.

About you

• 5+ years of experience in Data Engineering, with strong hands-on experience in Databricks.

• Expert knowledge of Databricks Unified Data Analytics Platform.

• Experience with Databricks Unity Catalog.

• Experience with Delta Live Tables (DLT).

• Experience with Auto Loader.

• Python / PySpark experience.

• SQL experience.

• Experience with Azure Data Factory.

• Strong understanding of data modeling and database design.

• Experience with ETL, data integration, and data warehousing.