Databricks Data Engineer — Build Scalable Pipelines

Private Advertiser; Taguig; On-site; PHP 800,000 - 1,400,000; Full time

Job summary

Private Advertiser is seeking an experienced Data Engineer specializing in Databricks to design, develop, and maintain robust data pipelines and ETL solutions. You will work closely with multiple teams to enhance data accessibility, quality, and processing efficiency, providing expert guidance on complex data engineering challenges.

The role requires strong hands-on Databricks proficiency, Delta Live Tables, Unity Catalog, PySpark, SQL, and Azure Data Factory, with a focus on scalable data

Qualifications

• 5+ years of experience in data engineering with hands-on Databricks experience.
• Strong knowledge of Databricks Unified Data Analytics Platform.
• Experience with Delta Live Tables (DLT), Auto Loader, and Unity Catalog.
• Proficiency in Python/PySpark and SQL.
• Experience with Azure Data Factory and data warehousing concepts.

Responsibilities

• Develop, optimize, and maintain data pipelines and ETL processes.
• Work with Databricks to build and manage scalable data solutions.
• Monitor and troubleshoot data quality and pipeline issues.
• Implement corrective actions to ensure reliable data processing.
• Collaborate with cross-functional teams on data engineering initiatives.
• Provide technical solutions and guidance to the team.
• Participate in key technical decisions and contribute to data projects.
• Document data processes, workflows, and technical solutions.
• Serve as a subject matter expert in Databricks and data engineering.

Skills

Databricks

PySpark

Python

SQL

Azure Data Factory

Delta Live Tables

Auto Loader

Data Modeling

ETL

Data Warehousing

5+ years experience

Tools

Databricks Unity Catalog

Job description

Private Advertiser is seeking an experienced Data Engineer specializing in Databricks to design, develop, and maintain robust data pipelines and ETL solutions. You will work closely with multiple teams to enhance data accessibility, quality, and processing efficiency, providing expert guidance on complex data engineering challenges.

The role requires strong hands-on Databricks proficiency, Delta Live Tables, Unity Catalog, PySpark, SQL, and Azure Data Factory, with a focus on scalable data