Data Engineer: Real-Time ELT Pipelines on AWS & Spark

Ryanair Group Holdings; Madrid; Sur place; EUR 50 000 - 80 000; Plein temps

Résumé du poste

Ryanair Labs, the technology arm of Ryanair Group Holdings, is recruiting a Data Engineer to join Europe’s largest airline group. Based in Madrid, you’ll design robust ELT pipelines, build batch and real-time processing, and maintain a governed data lake in AWS/Databricks.

You will collaborate with Data Science teams and other functions to enable analytics and insights across the business, while improving CI/CD and deployment practices in a fast-paced agile environment.

Qualifications

• 3+ years in data engineering or related data processing roles.
• Strong experience with varied data formats: JSON, CSV, Parquet, APIs, multiple DB engines.
• Hands-on data modelling in Big Data platforms (Databricks, Glue, Snowflake).
• Familiarity with event-driven architectures and AWS.
• At least 2 years of hands-on experience with AWS (IAM, S3, EC2, VPC).
• Ability to set up and maintain monitoring, alerting, and debugging solutions for pipelines.
• Experience collaborating with Data Science teams to support production-grade pipelines.
• Solid understanding of computing systems; strong SQL and data quality skills.

Responsabilités

• Design and develop automated ELT processes using Spark, Airflow, DBT, Python, Databricks.
• Build and maintain batch and real-time data processing using Kafka and AWS services.
• Maintain the data lake in AWS and Databricks with well-governed data models.
• Implement monitoring and observability for pipelines.
• Collaborate cross-functionally to identify, collect, and process data for business use cases.
• Support Data Science with stable, scalable environments for model deployment.
• Build and maintain CI/CD pipelines for automatic deployment and consistency.
• Help administer and maintain deployed infrastructure.
• Follow engineering standards across the Data Engineering team.
• Deliver work on time, managing priorities in line with team commitments.

Connaissances

Spark

Apache Airflow

DBT

Python

Databricks

AWS

Kafka

SQL

Data modelling

Dashboards

Outils

Databricks

Glue

Snowflake

Docker

Kubernetes

Description du poste

Ryanair Labs, the technology arm of Ryanair Group Holdings, is recruiting a Data Engineer to join Europe’s largest airline group. Based in Madrid, you’ll design robust ELT pipelines, build batch and real-time processing, and maintain a governed data lake in AWS/Databricks.

You will collaborate with Data Science teams and other functions to enable analytics and insights across the business, while improving CI/CD and deployment practices in a fast-paced agile environment.