Lead Data Engineer: AI-Powered Backend & Cloud

JobCubby; Hinoba-an; On-site; PHP 1,800,000 - 3,000,000; Full time

Job summary

Mastercard is seeking a Lead Data Engineer to join the AI & DPE Data Engineering platform. You will build and evolve large-scale backend data systems, real-time and batch pipelines, and AI-enabled services powering analytics and automation.

The role emphasizes Scala/Python/Java, CDP and Spark, and cloud-based architectures. You will work with massive datasets, leverage modern data platforms, and contribute to AI-driven workflows to transform data processing at global scale.

Qualifications

• BS/BA degree in Computer Science, Engineering, Information Systems, or related field.
• Strong hands-on experience with Scala, Python/Java in backend or data-intensive systems.
• Experience with Cloudera Data Platform (CDP) and Spark.
• Familiarity with Cloudera Manager for cluster administration, monitoring, or troubleshooting.
• Deep understanding of data modeling concepts, distributed systems, and large-scale data processing.

Responsibilities

• Design, develop, and maintain backend services and data pipelines using Scala, Python, and Java.
• Build and optimize batch and streaming workloads on CDP using Spark.
• Design and implement high-quality datamarts and curated datasets with emphasis on data integrity and performance.
• Collaborate with analytics teams to enable downstream consumers (visualization, reporting tools).
• Create clear technical documentation and participate in Agile/Scrum ceremonies.

Skills

Scala

Python

Java

CDP

Spark

Cloudera Manager

Data modeling

Distributed systems

Problem solving

Education

BS/BA in Computer Science, Engineering, Information Systems or related

Tools

Databricks

Kafka

Hadoop

Hive/Impala

Job description

Mastercard is seeking a Lead Data Engineer to join the AI & DPE Data Engineering platform. You will build and evolve large-scale backend data systems, real-time and batch pipelines, and AI-enabled services powering analytics and automation.

The role emphasizes Scala/Python/Java, CDP and Spark, and cloud-based architectures. You will work with massive datasets, leverage modern data platforms, and contribute to AI-driven workflows to transform data processing at global scale.