Lead Cloud Data Engineer: Scale AI-Ready Data Platforms

Engg; Lisboa; Presencial; EUR 90 000 - 130 000; Tempo integral

Resumo da oferta

Mastercard is seeking a Lead Cloud Data Engineer to design and deliver cloud-native data solutions at scale on AWS and Databricks. You will build batch, streaming, and real-time pipelines, enabling analytics, reporting, and AI workloads across the enterprise.

The role emphasizes modern Lakehouse architectures with Delta Lake and Iceberg, migrating from Hadoop, and driving scalable, secure data platforms for AI-driven insights.

Qualificações

• Experience with big data technologies (Hadoop, Spark, Hive).
• Cloud data engineering on AWS.
• Proficiency in Python, Java, or Scala.
• Experience building batch/streaming data pipelines.

Responsabilidades

• Design, develop, and support large-scale cloud-native data solutions on AWS and Databricks.
• Build batch, streaming, and real-time data pipelines for analytics and ML workloads.
• Lead modernization of data workloads from Hadoop to cloud-native architectures.

Conhecimentos

Big Data

Cloud data engineering

Distributed systems

Python/Java/Scala

AI/ML data platforms

Formação académica

BS/MS in Computer Science or related

Ferramentas

Databricks

Spark

Hadoop

Delta Lake

Apache Iceberg

Kafka

Terraform

Descrição da oferta de emprego

Mastercard is seeking a Lead Cloud Data Engineer to design and deliver cloud-native data solutions at scale on AWS and Databricks. You will build batch, streaming, and real-time pipelines, enabling analytics, reporting, and AI workloads across the enterprise.

The role emphasizes modern Lakehouse architectures with Delta Lake and Iceberg, migrating from Hadoop, and driving scalable, secure data platforms for AI-driven insights.