Senior Data Engineer - Build Scalable Data Pipelines & GenAI

Presight; Dubai; On-site; AED 240,000 - 420,000; Full time

Job summary

Presight, a leading data analytics company, seeks a Senior Data Engineer to assess and integrate diverse data sources into the Presight platform. You will design scalable data pipelines, perform web crawling and data processing, and deliver insights for clients across sectors.

You will work with Python, SQL, and AWS services to build robust data infrastructure, ensuring data quality, security, and governance across projects and teams.

Qualifications

• Bachelor-level degree in a computing discipline and strong fundamentals in data processing.
• Minimum 6+ years of programming experience with Python, Shell and Java.
• Experience with data ingestion, ETL/ELT, and data platforms on AWS.

Responsibilities

• Solve challenging problems using Python coding skills.
• Design, build and launch new ETL processes in production.
• Web crawling, data cleaning, annotation, ingestion and processing.
• Read and collate complex data sets for analysis.
• Create and maintain robust data pipelines.
• Continuously improve data processing efficiency and quality.
• Utilize Python, SQL, ES, and Shell to support data infrastructure.
• Provide insights into key performance metrics via analytics tools.
• Assist the wider business with data needs on ad-hoc requests.
• Follow QHSE, Security, Privacy and Governance policies.

Skills

Python

Shell

Java

Data analysis

Communication

Problem solving

Education

Bachelor's degree in Computer Engineering

Bachelor's degree in Computer Science

Bachelor's degree in Electrical Engineering and Computer Science

Tools

AWS

EC2

S3

SQS

Lambda

ElasticSearch

Redshift

CI/CD

PostgreSQL

SQL

NoSQL

Job description

Presight, a leading data analytics company, seeks a Senior Data Engineer to assess and integrate diverse data sources into the Presight platform. You will design scalable data pipelines, perform web crawling and data processing, and deliver insights for clients across sectors.

You will work with Python, SQL, and AWS services to build robust data infrastructure, ensuring data quality, security, and governance across projects and teams.