Senior Data Engineer - Hadoop, PySpark & Airflow Architect

Go Ahead Consulting

Dubai

On-site

AED 350,000 - 550,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Go Ahead Consulting in Dubai, UAE, seeks a Senior Data Engineer to own the design, building, scaling and maintenance of high-performance big data pipelines, Hadoop clusters, PySpark transformations, and Apache Airflow workflows integrated with GitHub.

You will lead cross-functional collaboration with data scientists, software engineers and recruitment leadership, ensure data governance and security, and deliver reliable analytics solutions across GCC engagements for an international technology

Qualifications

  • 5+ years of professional hands-on experience in big data engineering and distributed systems.
  • Proficiency in Hadoop ecosystem (HDFS, Hive, YARN) and PySpark.
  • Hands-on experience with Apache Airflow for workflow orchestration.
  • GitHub version control and collaborative software development.
  • Legal work authorization and UAE visa status for Dubai operations.

Responsibilities

  • Architect and scale robust big data pipelines with Hadoop and PySpark.
  • Develop and optimize Airflow DAGs for workflows.
  • Manage CI/CD integrations via GitHub and code reviews.
  • Process large datasets for analytics and ML readiness.
  • Ensure data security, governance, and documentation.
  • Collaborate with data science, software engineering, and product teams.

Skills

Big data engineering
Hadoop
PySpark
Airflow
GitHub
Data warehousing
SQL tuning
Stakeholder comms

Education

Bachelor's/Master's in CS/IT

Tools

HDFS
Hive
YARN
Docker
Kubernetes
Snowflake
BigQuery
Redshift
GitHub

Job description

Go Ahead Consulting in Dubai, UAE, seeks a Senior Data Engineer to own the design, building, scaling and maintenance of high-performance big data pipelines, Hadoop clusters, PySpark transformations, and Apache Airflow workflows integrated with GitHub.

You will lead cross-functional collaboration with data scientists, software engineers and recruitment leadership, ensure data governance and security, and deliver reliable analytics solutions across GCC engagements for an international technology

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer (Hadoop, PySpark & Apache Airflow) | Go Ahead Consulting | Dubai, UAE
Senior Data Engineer (Hadoop, PySpark & Apache Airflow) | Go Ahead Consulting | Dubai, UAE

Go Ahead Consulting • Dubai

On-site
AED 350,000 - 550,000
Data Engineer (PySpark)
Data Engineer (PySpark)

Black Pearl Consult • Abu Dhabi

On-site
AED 260,000 - 380,000
Senior Data Engineer: Pipelines, Spark & Azure DevOps
Senior Data Engineer: Pipelines, Spark & Azure DevOps

techcarrot FZ • Dubai

On-site
AED 240,000 - 480,000
Dubai-based PySpark Data Engineer | CDP & ETL Expert
Dubai-based PySpark Data Engineer | CDP & ETL Expert

HireAlpha • Dubai

On-site
AED 320,000 - 520,000
Data Engineer, Azure & Databricks + Airflow Expert
Data Engineer, Azure & Databricks + Airflow Expert

Tech Junction Ltd • Dubai

On-site
AED 240,000 - 420,000
Data Engineer
Data Engineer

HireAlpha • Dubai

On-site
AED 320,000 - 520,000
Senior Data Engineer: Snowflake, ETL & Governance
Senior Data Engineer: Snowflake, ETL & Governance

Link Development • United Arab Emirates

Remote
AED 240,000 - 420,000
Data Engineering Lead: Scalable Pipelines & Cloud
Data Engineering Lead: Scalable Pipelines & Cloud

Impelsys • Dubai

On-site
AED 350,000 - 550,000
Data Engineer: Python, Spark and ETL for Dubai Contract
Data Engineer: Python, Spark and ETL for Dubai Contract

edari • Dubai

On-site
AED 180,000 - 320,000
Senior Data Engineer – Azure Data & AI Pipelines
Senior Data Engineer – Azure Data & AI Pipelines

HireHouse • Dubai

On-site
AED 260,000 - 480,000
Annual ticket home
VISA sponsorship
Health insurance
+5
Top locations