Data Engineer

Etihad; Abu Dhabi; On-site; AED 180,000 - 240,000; Full time

Job summary

A leading airline in Abu Dhabi is looking for a Data Engineer responsible for designing and maintaining scalable data pipelines on Azure Databricks. The ideal candidate should have over 4 years of experience in data engineering, strong skills in Python and SQL, and familiarity with Azure technologies. This role involves collaborating with cross-functional teams to ensure data reliability and optimizing data workflows.

Qualifications

• 4+ years of experience as a Data Engineer or similar role.
• Hands-on experience with Azure Databricks, Spark, and Delta Lake.
• Experience handling structured and semi-structured data formats.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Azure Databricks.
• Collaborate with teams to define data models and transformation logic.
• Monitor and optimize pipeline performance and data quality.

Skills

Python

PySpark

SQL

Education

Bachelor's degree in computer science, Engineering, Information Systems, or related field

Tools

Azure Databricks

Azure Data Factory

Azure Data Lake (Gen2)

Job description

Synopsis

The Data Engineer will be responsible for designing, building, and maintaining the organisation’s modern data infrastructure, including the development of scalable data pipelines and the management of large, complex datasets within Azure Databricks and the broader Azure data ecosystem. In partnership with engineers, analysts, and data scientists, they will ensure data is reliable, accessible, and optimised for analytics, data science, and product decision-making, while contributing to the ongoing evolution of the organisation’s data platform.

Accountabilities

• Design, develop, and maintain scalable data pipelines on Azure Databricks
• Build robust workflows for both batch and streaming data pipelines using Spark and Delta Lake
• Ingest and process data from diverse sources into Azure Data Lake Storage (ADLS) and Azure Synapse Analytics
• Collaborate with cross-functional teams to define data models, transformation logic, and business rules
• Apply data warehouse design principles, including data modeling and partitioning strategies
• Work with both structured and unstructured data formats
• Apply data governance practices such as cataloging, lineage tracking, and compliance
• Monitor, troubleshoot, and optimize pipeline performance, reliability, and data quality
• Automate workflows using orchestration tools such as Azure Data Factory or Apache Airflow
• Enforce data governance and security standards in alignment with organizational compliance requirements
• Troubleshoot and resolve data-related issues and pipeline failures
• Continuously drive process improvements for faster, more reliable data delivery

Education & Experience

• 4+ years of experience as a Data Engineer, Data Platform Engineer, or in a similar role
• Bachelor's degree in computer science, Engineering, Information Systems, or a related field
• Hands-on experience with Azure Databricks, Spark, and Delta Lake to build and manage scalable ETL/ELT processes
• Strong Python, PySpark and SQL skills for data engineering and scripting tasks
• Experience with Azure Synapse, SQL Data Warehouse, or similar technologies
• Proficiency working with Azure Data Lake (Gen2) for storage and data processing
• Experience using Azure Data Factory for data orchestration
• Experience handling structured and semi-structured data formats (e.g., JSON, Parquet)
• Exposure and hands-on experience with Unit Testing and Data Testing suites is highly desirable and experience with tools such as
• Basic knowledge of Linux shell scripting and source control systems such as Git
• Exposure to other cloud platforms such as AWS or GCP is a plus

About Etihad Airways

Etihad Airways, the national airline of the UAE, was formed in 2003 and quickly went on to become one of the world’s leading airlines. From its home in Abu Dhabi, Etihad flies to passenger and cargo destinations in the Middle East, Africa, Europe, Asia, Australia and North America. Together with Etihad’s codeshare partners, Etihad’s network offers access to hundreds of international destinations. In recent years, Etihad has received numerous awards for its superior service and products, cargo offering, loyalty programme and more. All this ties into Etihad’s ambitious Journey 2030 strategy. The airline plans to double its fleet size and triple the number of customers over the next six years as it sets out to be the airline everyone wants to fly!

To learn more, visit etihad.com

Recruitment Fraud Alert

Beware of fraudulent job offers from individuals or organizations claiming to represent the Etihad group. We will never ask for personal information, bank details, or payment during the recruitment process. Interviews are conducted face-to-face or via video/telephone before any formal offer. If you are asked for money, please treat it as fraudulent.