Data Engineer

Etihad Airways; Abu Dhabi; On-site; AED 120,000 - 200,000; Full time

Job summary

Etihad Airways is looking for an experienced Data Engineer to lead the development of scalable data pipelines. This role involves hands-on work with tools like Databricks and Apache Spark, mentoring junior engineers, and ensuring high standards of data governance and compliance. The ideal candidate will possess a Bachelor's degree, strong Python and SQL skills, and relevant experience in cloud-based data platforms, particularly within the Azure ecosystem.

Qualifications

• 5+ years of experience in data engineering or related field.
• Experience with Databricks, Delta Lake, and Apache Spark.
• Strong communication and documentation skills.

Responsibilities

• Design and optimize scalable data pipelines using Databricks.
• Lead and mentor junior engineers through technical discussions.
• Manage workflows across Azure Data Lake Storage and Azure Synapse.

Skills

Python

SQL

Data governance

Data modeling

Containerization

Education

Bachelor’s degree in computer science or related field

Tools

Databricks

Azure Databricks

Apache Spark

Delta Lake

Azure Data Factory

Azure Data Lake

Azure Synapse Analytics

Docker

Terraform

Bicep

Job description

We are seeking an experienced and proactive Data Engineer to lead the development of scalable, production-grade data pipelines while mentoring junior engineers and shaping engineering standards. You will work hands-on with Databricks (including Azure Databricks), Delta Lake, and Apache Spark to support data-driven decision-making across analytics, product, and data science teams. This role combines technical expertise with team leadership, ideal for someone ready to take ownership of critical data systems and guide others.

Accountabilities

1. Design, develop, and optimize scalable data pipelines using Databricks and Azure Databricks, including Apache Spark and Delta Lake.
2. Lead and mentor junior engineers through code reviews, architecture discussions, and technical guidance.
3. Collaborate with cross-functional teams to define data requirements and deliver reliable data solutions.
4. Manage workflows across Azure Data Lake Storage, Azure Synapse Analytics, and Azure Data Factory (or equivalent orchestration tools).
5. Contribute to platform architecture decisions involving data modeling, processing frameworks, and performance tuning.
6. Implement CI / CD pipelines for data workflows using tools like Azure DevOps or GitHub Actions.
7. Enforce engineering best practices around testing, documentation, and maintainability.
8. Monitor, troubleshoot, and resolve issues related to data pipeline performance and reliability.
9. Ensure data governance, quality, and compliance by integrating with tools like Unity Catalog or Azure Purview.

Education & Experience

1. Bachelor’s degree in computer science or a related field. 5+ years of experience in data engineering or a closely related technical field.
2. Strong proficiency in Python and SQL for building and managing data workflows.
3. Hands-on experience with both Databricks and Azure Databricks, including production use of Apache Spark and Delta Lake.
4. Familiarity with cloud-based data platforms (preferably Microsoft Azure).
5. Experience with Azure Data Factory, Azure Data Lake, and/or Azure Synapse Analytics.
6. Demonstrated ability to lead technical projects and mentor junior engineers. Solid grasp of CI / CD practices and version control systems (e.g., Git).
7. Preferred skills include exposure to data transformation tools like dbt.
8. Familiarity with data governance tools such as Unity Catalog, Azure Purview, or similar.
9. Experience with containerization (e.g., Docker) and infrastructure-as-code tools (e.g., Terraform, Bicep).
10. Strong communication and documentation skills; able to interface with technical and non-technical stakeholders.