Big Data Engineer - Government Sector - 1

Apt Resources; Abu Dhabi; On-site; AED 180,000 - 240,000; Full time

Job summary

Apt Resources is looking for an experienced Big Data Engineer for a government client in Abu Dhabi. You will play a key role in designing and implementing data solutions for AI/ML initiatives, contributing to digital transformation in the public sector.

Qualifications

• 10-12 years of hands-on big data experience.
• Expertise in Python, SQL/NoSQL databases, Airflow, ETL/ELT pipeline development.
• Experience with cloud data platforms (Azure AWS or GCP).

Responsibilities

• Build robust data pipelines using Python SQL/NoSQL and Airflow.
• Develop ETL/ELT processes for structured/unstructured data.
• Design efficient data models for analytics.

Skills

Python

SQL/NoSQL

Airflow

ETL/ELT

Cloud data platforms

Job description

Description

Apt Resourcesis seeking an experiencedBig Data Engineerfor agovernment client in Abu Dhabi. You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.

Key Responsibilities:

Data Pipeline Development:

• Build robust data pipelines usingPython SQL/NoSQL and Airflow
• DevelopETL/ELT processesfor structured/unstructured data
• Managedata lakesand optimize storage solutions

Data Infrastructure:

• Design efficientdata modelsfor analytics
• Implementdata governanceand quality frameworks
• Work withcloud-based data platforms(Azure preferred)

AI/ML Support:

• Prepare and process datasets for machine learning applications
• Collaborate with ML teams on feature engineering

Requirements

• 10-12 yearsof hands-on big data experience
• Expertise in:
• PythonandSQL/NoSQLdatabases
• Airflowfor workflow orchestration
• ETL/ELTpipeline development
• Cloud data platforms(Azure AWS or GCP)

Benefits

To be discussed