Data Engineer

Etihad Airways; Abu Dhabi; On-site; AED 120,000 - 200,000; Full time

Job summary

A leading airline based in Abu Dhabi seeks a skilled Data Engineer to design and maintain scalable data infrastructure using Azure Databricks. The role involves developing data pipelines, ensuring data quality, and collaborating with cross-functional teams. Ideal candidates have 4+ years of experience in data engineering and strong skills in Python, SQL, and data governance. Join us in shaping the future of aviation analytics.

Qualifications

• 4+ years of experience in data engineering roles.
• Hands-on experience with Azure Databricks for ETL processes.
• Exposure to cloud platforms like AWS or GCP is a plus.

Responsibilities

• Design and maintain scalable data pipelines on Azure Databricks.
• Monitor and optimize pipeline performance and data quality.
• Automate workflows using orchestration tools.

Skills

Python

PySpark

SQL

Data Engineering

Data Governance

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Databricks

Azure Data Lake (Gen2)

Azure Data Factory

Apache Airflow

SQL Data Warehouse

Job description

Synopsis

The Data Engineer will be responsible for designing, building, and maintaining the organisation’s modern data infrastructure, including the development of scalable data pipelines and the management of large, complex datasets within Azure Databricks and the broader Azure data ecosystem. In partnership with engineers, analysts, and data scientists, they will ensure data is reliable, accessible, and optimised for analytics, data science, and product decision-making, while contributing to the ongoing evolution of the organisation’s data platform.

Accountabilities

• Design, develop, and maintain scalable data pipelines on Azure Databricks
• Build robust workflows for both batch and streaming data pipelines using Spark and Delta Lake
• Ingest and process data from diverse sources into Azure Data Lake Storage (ADLS) and Azure Synapse Analytics
• Collaborate with cross-functional teams to define data models, transformation logic, and business rules
• Apply data warehouse design principles, including data modeling and partitioning strategies
• Work with both structured and unstructured data formats
• Apply data governance practices such as cataloging, lineage tracking, and compliance
• Monitor, troubleshoot, and optimize pipeline performance, reliability, and data quality
• Automate workflows using orchestration tools such as Azure Data Factory or Apache Airflow
• Enforce data governance and security standards in alignment with organizational compliance requirements
• Troubleshoot and resolve data-related issues and pipeline failures
• Continuously drive process improvements for faster, more reliable data delivery

Education & Experience

• 4+ years of experience as a Data Engineer, Data Platform Engineer, or in a similar role
• Bachelor's degree in computer science, Engineering, Information Systems, or a related field
• Hands-on experience with Azure Databricks, Spark, and Delta Lake to build and manage scalable ETL / ELT processes
• Strong Python, PySpark and SQL skills for data engineering and scripting tasks
• Experience with Azure Synapse, SQL Data Warehouse, or similar technologies
• Proficiency working with Azure Data Lake (Gen2) for storage and data processing
• Experience using Azure Data Factory for data orchestration
• Experience handling structured and semi-structured data formats (e.g., JSON, Parquet)
• Exposure and hands-on experience with Unit Testing and Data Testing suites is highly desirable
• Basic knowledge of Linux shell scripting and source control systems such as Git
• Exposure to other cloud platforms such as AWS or GCP is a plus

About Etihad Airways

Etihad Airways, the national airline of the UAE, was formed in 2003 and quickly went on to become one of the world’s leading airlines. From its home in Abu Dhabi, Etihad flies to passenger and cargo destinations in the Middle East, Africa, Europe, Asia, Australia and North America. Together with Etihad’s codeshare partners, Etihad’s network offers access to hundreds of international destinations. In recent years, Etihad has received numerous awards for its superior service and products, cargo offering, loyalty programme and more. All this ties into Etihad’s ambitious Journey 2030 strategy. The airline plans to double its fleet size and triple the number of customers over the next six years as it sets out to be the airline everyone wants to fly!

To learn more, visit etihad.com

Recruitment Fraud Alert

Beware of fraudulent job offers from individuals or organizations claiming to represent the Etihad group. We will never ask for personal information, bank details, or payment during the recruitment process. Interviews are conducted face-to-face or via video / telephone before any formal offer. If you are asked for money, please treat it as fraudulent.