Big Data Engineer - Government Sector - 1

Apt Resources; Abu Dhabi; On-site; AED 300,000 - 400,000; Full time

Job summary

A recruitment agency is seeking an experienced Big Data Engineer for a government client in Abu Dhabi. The role involves designing and implementing large-scale data solutions to support AI/ML initiatives. Ideal candidates should have 10-12 years of hands-on experience and expertise in Python, SQL/NoSQL, and cloud data platforms such as Azure. The position contributes to public sector digital transformation.

Qualifications

• 10-12 years of hands-on big data experience.
• Expertise in Python and SQL/NoSQL databases.
• Experience with Airflow for workflow orchestration.

Responsibilities

• Build robust data pipelines using Python, SQL/NoSQL, and Airflow.
• Develop ETL/ELT processes for structured/unstructured data.
• Design efficient data models for analytics.

Skills

Python

SQL/NoSQL

Airflow

ETL/ELT

Cloud data platforms (Azure, AWS, GCP)

Job description

Description

Apt Resources is seeking an experienced Big Data Engineer for a government client in Abu Dhabi. You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.

Key Responsibilities

Data Pipeline Development:

• Build robust data pipelines using Python SQL/NoSQL and Airflow
• Develop ETL/ELT processes for structured/unstructured data
• Manage data lakes and optimize storage solutions

Data Infrastructure:

• Design efficient data models for analytics
• Implement data governance and quality frameworks
• Work with cloud-based data platforms (Azure preferred)

AI/ML Support:

• Prepare and process datasets for machine learning applications
• Collaborate with ML teams on feature engineering

Requirements

• 10-12 years of hands‑on big data experience
• Expertise in:
  • Python and SQL/NoSQL databases
  • Airflow for workflow orchestration
  • ETL/ELT pipeline development
  • Cloud data platforms (Azure AWS or GCP)

Benefits

To be discussed