Data Engineering Lead

Impelsys; Dubai; On-site; AED 420,000 - 640,000; Full time

Job summary

Impelsys in Dubai is seeking a seasoned Data Engineering Lead to provide technical leadership across data projects and squads. You will design scalable pipelines, mentor engineers, and drive best practices in ETL/ELT, Airflow, and DBT.

The role requires hands-on experience with Apache Airflow, DBT, Python, SQL, and AWS, plus strong collaboration with data scientists and product teams to deliver reliable, cost-effective data solutions.

Qualifications

• Proven hands-on experience with Apache Airflow.
• Strong knowledge of DBT (Data Build Tool).
• Extensive SQL and relational database experience.
• Hands-on experience with AWS data services.
• Experience designing scalable data pipelines.
• Experience mentoring and leading technical teams.

Responsibilities

• Provide technical leadership across data acquisition, transformation, and distribution.
• Lead, mentor, and coach Data Engineers, Data Architects, and Database Administrators.
• Design, implement, and manage scalable data pipelines using Apache Airflow.
• Develop, test, and maintain Airflow DAGs and custom operators.
• Monitor, troubleshoot, and optimize Airflow workflows for performance and reliability.
• Develop, test, and maintain DBT infrastructure and models executed through Airflow.
• Manage DBT infrastructure upgrades and optimize DBT code for performance.
• Integrate DBT workflows with Apache Airflow.

Skills

Python

SQL

ETL/ELT concepts

Problem-solving

Communication

Collaboration

Mentoring

Leadership

Data quality

Tools

Apache Airflow

DBT

Git

AWS

ECS/Fargate/EC2/EKS

Job description

We are currently hiring for a Data Engineering Lead position, and your profile appears relevant to the opportunity.

Please find the key details below:

Data Engineering Lead

Location: Trade Center Second - Dubai

Job Type: Long-Term Contract

Job Summary

We are looking for an experienced Data Engineering Lead to provide technical leadership across multiple data engineering projects and squads.

The ideal candidate will have strong hands-on experience with Apache Airflow, DBT, Python, SQL, and AWS, along with proven experience designing scalable data pipelines and leading data engineering teams.

You will be responsible for developing and optimizing Airflow workflows, managing DBT infrastructure, improving data engineering architecture, and ensuring reliable, scalable, and cost-effective data solutions.

Key Responsibilities

• Provide technical leadership across data acquisition, transformation, and distribution.
• Lead, mentor, and coach Data Engineers, Data Architects, and Database Administrators.
• Design, implement, and manage scalable data pipelines using Apache Airflow.
• Develop, test, and maintain complex Airflow DAGs and custom operators.
• Monitor, troubleshoot, and optimize Airflow workflows for performance and reliability.
• Develop, test, and maintain DBT infrastructure and models executed through Airflow.
• Manage DBT infrastructure upgrades and optimize DBT code for performance and efficiency.
• Integrate DBT workflows with Apache Airflow.
• Ensure data quality, integrity, reliability, and consistency across data pipelines.
• Collaborate with Data Engineers, Data Scientists, Product Owners, and other stakeholders to translate requirements into scalable solutions.
• Recommend improvements to data engineering architecture, frameworks, and technologies.
• Drive adoption of modern ETL/ELT, workflow orchestration, and data management practices.
• Document workflows, processes, configurations, and technical solutions.
• Troubleshoot production issues and drive continuous improvement.

Required Skills & Experience

• Proven hands-on experience with Apache Airflow.
• Strong experience designing and maintaining complex Airflow DAGs.
• Good Knowledge with DBT (Data Build Tool).
• Experience managing DBT infrastructure upgrades and optimizing DBT code.
• Strong SQL and relational database experience.
• Strong understanding of ETL/ELT concepts and data pipeline architecture.
• Hands-on experience with AWS data and infrastructure services.
• Experience with ECS, Fargate, EC2, and EKS.
• Experience with Git and version control.
• Strong understanding of data quality, monitoring, troubleshooting, and performance optimization.
• Excellent problem-solving, communication, and collaboration skills.
• Proven experience mentoring and leading technical teams.

AWS Infrastructure Responsibilities

• Manage and optimize AWS infrastructure supporting Apache Airflow.
• Hands-on experience with Amazon ECS, AWS Fargate, Amazon EC2, and Amazon EKS.
• Ensure Airflow infrastructure is scalable, reliable, secure, and cost-effective.
• Troubleshoot infrastructure, deployment, and performance issues.
• Support cloud infrastructure optimization and automation.

Key Skills

Must Have:

Nice to Have:

Nice to Have

• Experience with modern data architecture and cloud-native data platforms.
• Experience with CI/CD and infrastructure-as-code tools such as Terraform.
• Experience with Agile/Scrum methodologies.