Senior Data Engineer - Real-Time Pipelines (Databricks)

Penbrothers International; Mandaluyong; Hybrid; PHP 1,000,000 - 1,500,000; Full time

Job summary

Penbrothers International seeks Data Engineers to join our Manila-based offshore team, building scalable, high-performance data solutions for gaming, sportsbook, payments, and marketing. You will work on both real-time and batch data pipelines with Databricks at the core of our data platform.

Under the Manila Team Lead, you will collaborate with engineers, product owners, and business stakeholders in Manila and Malta to deliver reliable data products, participate in code reviews, and contribute

Qualifications

• Experience building data pipelines with Databricks and Apache Airflow.
• Hands-on with Databricks or Snowflake in modern data architectures.
• Experience with streaming data technologies such as Kafka, Spark, or Flink.
• Proficiency in Python and/or Java, with solid software engineering fundamentals.
• Good knowledge of SQL and databases (MySQL, PostgreSQL, Elasticsearch, MongoDB).
• Experience with cloud platforms, preferably AWS.
• Familiarity with data lakes and lakehouse patterns.
• Data modelling skills and translating business requirements into technical solutions.
• Experience with APIs and data exposure patterns (REST).
• Awareness of data quality, monitoring, and observability practices.
• Experience in Agile environments.

Responsibilities

• Build and maintain scalable data pipelines integrating multiple data sources.
• Develop real-time and batch data processing solutions using Databricks, Spark, Kafka, and Airflow.
• Develop, maintain, and extend data models, tests, and documentation for the data transformation layer.
• Implement and maintain data integrations with third-party platforms (CRM, marketing, financial systems).
• Support data quality, integrity, and reliability through validation, reconciliation, and monitoring frameworks.
• Collaborate with cross-functional teams to deliver end-to-end data and marketing solutions.
• Participate in code reviews and follow engineering best practices for testing and deployment.
• Contribute to agile ceremonies and continuously improve engineering practices.

Job description

Penbrothers International seeks Data Engineers to join our Manila-based offshore team, building scalable, high-performance data solutions for gaming, sportsbook, payments, and marketing. You will work on both real-time and batch data pipelines with Databricks at the core of our data platform.

Under the Manila Team Lead, you will collaborate with engineers, product owners, and business stakeholders in Manila and Malta to deliver reliable data products, participate in code reviews, and contribute