Senior Data Engineer: Spark, ETL & Azure Cloud

JobCubby; Hinoba-an; On-site; PHP 900,000 - 1,400,000; Full time

Benefits offered by this job

Skills development

Global work environment

Opportunities to try new ideas

Job summary

Amadeus is seeking a Data Engineer 3 to design, build, and maintain data marts, ETL pipelines, and analytical assets. You will ensure reliability, scalability, and performance of our data platforms while implementing monitoring and alerting to uphold data quality.

The ideal candidate has hands-on production experience with Scala (preferred) or PySpark/Java, and deep knowledge of big data ecosystems including Spark, Hadoop, Kafka, Impala, and SQL.

Qualifications

• Education: University degree in computer science or related field.
• Proven track record in data engineering.
• Strong experience defining ETL processes.
• Experience with data modeling and data visualization concepts and tools.

Responsibilities

• Design, implement, deploy, and maintain data marts, ETL processes and systems.
• Ensure reliability, scalability, and performance of data assets.
• Design and maintain quality indicators and monitoring/alerting.

Skills

Scala

PySpark

Java

Apache Spark

Hadoop

Kafka

SQL

MongoDB

Maven

SBT

DevOps

Tableau

Python

Bash

MAPR

Azure

Databricks

Databricks SQL

Education

University degree in computer science or related field

Tools

MAPR distribution

Azure

Databricks

MongoDB

Job description

Amadeus is seeking a Data Engineer 3 to design, build, and maintain data marts, ETL pipelines, and analytical assets. You will ensure reliability, scalability, and performance of our data platforms while implementing monitoring and alerting to uphold data quality.

The ideal candidate has hands-on production experience with Scala (preferred) or PySpark/Java, and deep knowledge of big data ecosystems including Spark, Hadoop, Kafka, Impala, and SQL.