Senior Data Engineer: Azure Databricks & Lakehouse

ERNI; Mandaluyong; Hybrid; PHP 1,800,000 - 3,000,000; Full time

Benefits offered by this job

Private HMO

Insurance from day one

5-year anniversary trip to Europe ERNI

13th-month pay

Free training and certifications

Baby basket

Fruit basket

Free snacks and coffee

Job summary

ERNI in Mandaluyong is seeking a senior data engineer to design, build, and optimize scalable data pipelines on a modern cloud data platform. You will own end-to-end data lifecycle from ingestion to analytics-ready datasets, collaborating with product and analytics teams.

The role requires 8+ years of experience, deep Azure Databricks expertise, and strong stakeholder communication. Hybrid work setup and opportunities for advancement are offered by ERNI.

Qualifications

• 8+ years of professional data engineering experience designing and delivering enterprise data pipelines and analytics-ready datasets.
• Azure and Azure Databricks expertise required with Delta Lake, PySpark, Spark SQL, and SQL experience.
• Strong understanding of cloud-native data engineering patterns for ingestion, transformation, orchestration, monitoring, and production support.
• Experience building data pipelines processing large volumes of structured, semi-structured, and unstructured data from multiple sources.
• Strong data modeling, data marts, curated data layers, and business-facing datasets for reporting and analytics.
• Ability to translate business rules and data definitions into technical implementation details and clarify requirements with stakeholders.
• Experience with source-to-target mapping, data profiling, validation, reconciliation, and data quality management.
• Experience with orchestration and scheduling tools like Azure Data Factory, Databricks Workflows, Airflow.

Responsibilities

• Design, develop, and optimize automated data pipelines, ETL/ELT workflows, data models, and curated data layers using Azure, Azure Databricks, Delta Lake, PySpark, SQL.
• Build scalable ingestion, transformation, validation, and publishing processes across reporting, analytics, and operations.
• Collaborate with business stakeholders to clarify requirements, data definitions, and acceptance criteria.
• Translate requirements into source-to-target mappings, dataset designs, and delivery estimates.
• Develop reusable data engineering frameworks to improve speed, reliability, monitoring, and maintainability.
• Ensure data quality, lineage, auditability, security, privacy, access management, and compliance across data products.
• Monitor pipeline health, troubleshoot incidents, and perform root-cause analysis for continuous improvement.
• Work with cross-functional teams to ensure data infrastructure meets business needs.

Skills

Azure

Azure Databricks

Delta Lake

PySpark

Spark SQL

SQL

ETL/ELT development

Data pipeline design

Data modeling

Data quality controls

Production support

Performance tuning

Stakeholder requirements

Airflow

Azure Data Factory

Databricks Workflows

Tools

Azure Data Factory

Databricks Workflows

Airflow

Job description

ERNI in Mandaluyong is seeking a senior data engineer to design, build, and optimize scalable data pipelines on a modern cloud data platform. You will own end-to-end data lifecycle from ingestion to analytics-ready datasets, collaborating with product and analytics teams.

The role requires 8+ years of experience, deep Azure Databricks expertise, and strong stakeholder communication. Hybrid work setup and opportunities for advancement are offered by ERNI.