Senior Data Engineer - Hybrid (Databricks, Kafka & Streaming)

Penbrothers; Mandaluyong; Hybrid; PHP 1,200,000 - 2,400,000; Full time

Job summary

Penbrothers is seeking a Data Engineer to join our Manila-based offshore team, building scalable data pipelines and real-time processing using Databricks, Airflow, Kafka, and lakehouse patterns. You will collaborate with engineers, product owners, and stakeholders in Manila and Malta to deliver reliable data products in a hybrid work setup (2 days onsite in Mandaluyong).

Day shift 10:00 AM to 7:00 PM Philippine time, contributing to data modeling, APIs, testing, and observability while embracing

Qualifications

• Experience building and maintaining data pipelines using Databricks and Apache Airflow.
• Hands-on experience with modern data architectures (e.g., Snowflake).
• Experience with streaming and real-time data technologies such as Kafka, Spark, or Flink.

Responsibilities

• Build and maintain scalable datapipelines integrating multiple internal and external datasources.
• Develop and maintain real-time and batch data processing solutions using Databricks, Spark, Kafka, and Airflow.
• Develop, maintain, and extend data models, tests, and documentation for the data transformation layer.
• Implement and maintain data integrations with third-party platforms.
• Support data quality, integrity, and reliability through validation and monitoring frameworks.
• Contribute to data models across multiple business domains under guidance of Team Lead.
• Build and maintain data services and APIs for internal/external consumption.
• Monitor, troubleshoot and resolve production issues; participate in on-call rotation.
• Collaborate with cross-functional teams to deliver end-to-end data and marketing solutions.
• Participate in code reviews and follow engineering best practices for testing and deployment.
• Contribute to agile ceremonies and continuously improve practices.

Skills

Databricks

Airflow

Kafka

Spark

Python/Java

SQL

AWS

Data Modeling

APIs

Observability

Agile

Tools

Snowflake

REST APIs

Kafka

Flink

Elasticsearch

Job description

Penbrothers is seeking a Data Engineer to join our Manila-based offshore team, building scalable data pipelines and real-time processing using Databricks, Airflow, Kafka, and lakehouse patterns. You will collaborate with engineers, product owners, and stakeholders in Manila and Malta to deliver reliable data products in a hybrid work setup (2 days onsite in Mandaluyong).

Day shift 10:00 AM to 7:00 PM Philippine time, contributing to data modeling, APIs, testing, and observability while embracing