Data Engineering Lead

Impelsys

Dubai

Sur place

AED 350 000 - 550 000

Plein temps

Il y a 4 jours
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

Impelsys is seeking an experienced Data Engineering Lead to provide technical leadership across multiple data engineering projects and squads in the UAE. The ideal candidate will have hands-on expertise with Apache Airflow, DBT, Python, SQL, and AWS, and a track record of designing scalable data pipelines.

You will develop and optimize Airflow workflows, manage DBT infrastructure, improve data architecture, and ensure reliable, cost-effective data solutions while mentoring data engineers and

Qualifications

  • Proven leadership of data engineering teams across multiple projects.
  • Hands-on expertise with Airflow, DBT, Python, SQL and AWS.
  • Strong design and optimization of scalable data pipelines.

Responsabilités

  • Provide technical leadership across data acquisition, transformation, and distribution.
  • Lead, mentor, and coach Data Engineers, Data Architects, and DBAs.
  • Design, implement, and manage scalable data pipelines using Apache Airflow.
  • Develop, test, and maintain Airflow DAGs and custom operators.
  • Monitor, troubleshoot, and optimize Airflow workflows.
  • Develop and maintain DBT infrastructure and models invoked via Airflow.
  • Manage DBT infrastructure upgrades and optimize DBT code.
  • Integrate DBT workflows with Airflow.
  • Ensure data quality and consistency across pipelines.
  • Collaborate with stakeholders to translate requirements into scalable solutions.
  • Drive improvements to data architecture, frameworks, and technologies.
  • Promote best practices in ETL/ELT, workflow orchestration, and data management.
  • Document workflows, configurations, and technical solutions.
  • Troubleshoot production issues and drive continuous improvement.

Connaissances

Leadership
Mentoring
Communication
Problem solving

Outils

Apache Airflow
DBT
Python
SQL
AWS
ECS
Fargate
EC2
EKS
Git

Description du poste

By using this form you agree with the storage and handling of your data by this website. *

We are looking for an experiencedData EngineeringLeadto provide technical leadership across multiple data engineering projects and squads.

The ideal candidate will have strong hands-on experience withApache Airflow, DBT, Python, SQL, and AWS, along with proven experience designing scalable data pipelines and leading data engineering teams.

You willbe responsible fordeveloping andoptimizingAirflow workflows, managing DBT infrastructure, improving data engineering architecture, and ensuring reliable, scalable, and cost-effective data solutions.

Key Responsibilities
  • Provide technical leadership across data acquisition, transformation, and distribution.
  • Lead, mentor, and coach Data Engineers, Data Architects, and Database Administrators.
  • Design, implement, and manage scalable data pipelines usingApache Airflow.
  • Develop, test, andmaintaincomplexAirflow DAGs and custom operators.
  • Monitor, troubleshoot, andoptimizeAirflow workflows for performance and reliability.
  • Develop, test, and maintainDBT infrastructure and modelsexecuted through Airflow.
  • Manage DBT infrastructure upgrades and optimize DBT code for performance and efficiency.
  • Integrate DBT workflows with Apache Airflow.
  • Ensure data quality, integrity, reliability, and consistency across data pipelines.
  • Collaborate with Data Engineers, Data Scientists, Product Owners, and other stakeholders to translate requirements into scalable solutions.
  • Recommend improvements to data engineering architecture, frameworks, and technologies.
  • Drive adoption of modernETL/ELT, workflow orchestration, and data managementpractices.
  • Document workflows, processes, configurations, and technical solutions.
  • Troubleshoot production issues and drive continuous improvement.
Required Skills & Experience
  • Proven hands-on experience withApache Airflow.
  • Strong experience designing andmaintainingcomplex Airflow DAGs.
  • Good Knowledge withDBT (Data Build Tool).
  • Experience managing DBT infrastructure upgrades and optimizing DBT code.
  • StrongSQLand relational database experience.
  • Strong understanding ofETL/ELTconcepts and data pipeline architecture.
  • Hands-on experience withAWSdata and infrastructure services.
  • Experience withECS, Fargate, EC2, and EKS.
  • Experience withGitand version control.
  • Strong understanding of data quality, monitoring, troubleshooting, and performance optimization.
  • Excellent problem-solving, communication, and collaboration skills.
  • Proven experience mentoring and leading technical teams.
AWS Infrastructure Responsibilities
  • Manage andoptimizeAWS infrastructure supporting Apache Airflow.
  • Hands-on experience withAmazon ECS, AWS Fargate, Amazon EC2, and Amazon EKS.
  • Ensure Airflow infrastructure is scalable, reliable, secure, and cost-effective.
  • Troubleshoot infrastructure, deployment, and performance issues.
  • Support cloud infrastructure optimization and automation.
Must Have
  • DBT
  • Python
  • AWS (ECS/Fargate/EC2/EKS)
  • SQL
Nice to Have
  • ETL/ELT
  • Enterprise Data Warehousing
  • Git
Nice to Have
  • Experience with modern data architecture and cloud-native data platforms.
  • Experience with CI/CD and infrastructure-as-code tools such as Terraform.
  • Experience with Agile/Scrum methodologies.
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior Data Engineer
Senior Data Engineer

Dicetek LLC • Dubai

Sur place
AED 360 000 - 600 000
Data Engineering Lead: Scalable Pipelines & Cloud
Data Engineering Lead: Scalable Pipelines & Cloud

Impelsys • Dubai

Sur place
AED 350 000 - 550 000
Data Engineer
Data Engineer

CNTXT, Inc. • Abu Dhabi

Sur place
AED 240 000 - 420 000
AWS Data Engineer
AWS Data Engineer

Salt • Abu Dhabi

Sur place
AED 480 000 - 720 000
Data Engineer | Talent Bridge Dubai
Data Engineer | Talent Bridge Dubai

talentbridgedubai • Dubai

Sur place
AED 150 000 - 320 000
Data Platform Engineer
Data Platform Engineer

Dicetek LLC • Abu Dhabi

Sur place
AED 280 000 - 420 000
Data Engineer
Data Engineer

Acesoft Labs (India) Pvt Ltd • Dubai

Hybride
AED 200 000 - 350 000
Data Tech Lead
Data Tech Lead

TEN-XER • Dubai

Sur place
AED 400 000 - 650 000
Data Engineer
Data Engineer

Dicetek LLC • Abu Dhabi

Sur place
AED 240 000 - 380 000
Senior Data Engineer
Senior Data Engineer

Salt • Abu Dhabi

Sur place
AED 300 000 - 420 000
Lieux principaux