Senior Data Engineer

Presight; United Arab Emirates; On-site; AED 300,000 - 420,000; Full time

Job summary

Presight is seeking a Senior Data Engineer to assess and work with data concepts, use cases and complex data sources to deliver insights and support integration into the Presight platform.

You will design and implement data extraction, transformation, and loading pipelines, crawling and cleaning data, and building analytical tools to monitor business performance. Strong Python, SQL, and AWS experience are essential.

Qualifications

• Bachelor's degree in computer engineering, Computer Science, or Electrical Engineering and Computer Sciences.
• 6+ years of programming experience with solid coding in Python, Shell and Java.
• Experience with Web crawling and data cleaning.
• Experience with solution architecture, data ingestion, query optimization, data segregation, ETL/ELT, AWS services (EC2, S3, SQS, Lambda), Elastic Search and Redshift, CI/CD workflows.
• Knowledge of data platform concepts: data lakes, data warehouses, ETL/ELT, big data processing, real-time processing; scheduling and monitoring of ETL/ELT jobs.
• Proficiency in PostgreSQL and programming (Java/Python); understanding of data, ERs, structured/unstructured data, SQL/NoSQL.
• Knowledge of best practices to optimize columnar/distributed data processing systems and infrastructure.
• Experience in dimensional modelling and data mining techniques (statistical modelling, text mining, information retrieval).

Responsibilities

• Solve challenging problems using Python coding techniques.
• Design, build and launch new data extraction, transformation, and loading processes in production.
• Web crawling, data cleaning, annotation, ingestion and processing.
• Read and collate complex data sets.
• Create and maintain data pipelines.
• Drive process improvements for efficiency and productivity.
• Use Python, SQL, ES, Shell to build data infrastructure for ETL/ELT.
• Provide insights into key business metrics via analytics tooling.
• Support the wider business with data needs on an ad hoc basis.
• Comply with QHSE, information security, privacy and governance policies.

Skills

Communication skills

Analytical thinking

Problem solving

Education

Bachelor's degree in computer engineering / CS / EE & CS

Tools

PostgreSQL

ElasticSearch

Redshift

AWS

EC2

S3

SQS

Lambda

CI/CD

Job description

About Presight

Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region’s leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive societal impact. Presight excels at all-source data interpretation to support insight‑driven decision‑making that shapes policy and creates safer, healthier, happier, and more sustainable societies. Today, through its range of GenAI-driven products and solutions, Presight is bringing Applied AI to the private and public sector, enabling them to realize their AI strategy and ambitions faster.

Job Description

Overview

About Presight

Presight is an ADX-listed public company with Abu Dhabi based G42 as its majority shareholder and is the region’s leading big data analytics company powered by GenAI. It combines big data, analytics, and AI expertise to serve every sector, of every scale, to create business and positive societal impact. Presight excels at all-source data interpretation to support insight‑driven decision‑making that shapes policy and creates safer, healthier, happier, and more sustainable societies. Today, through its range of GenAI-driven products and solutions, Presight is bringing Applied AI to the private and public sector, enabling them to realize their AI strategy and ambitions faster.

The Opportunity

Presight is looking for an astute, proficient and qualified Senior Data Engineer to assess, analyze and work with data concepts, use‑cases & complex new data sources to provide business insights to customers and support the implementation & integration of the data sources into the Presight platform.

Responsibilities

• Solve challenging problems, using python coding skills.
• Design, build and launch new data extraction, transformation & loading processes in production.
• Web crawling, data cleaning, data annotation, data ingestion and data processing.
• Reading and collating complex data sets.
• Creating and maintaining data pipelines.
• Continual focus on process improvement to drive efficiency and productivity within the team.
• Use of Python, SQL, ES, Shell etc. to build the infrastructure required for optimal extraction, transformation, and loading of data.
• Provide insights into key business performance metrics by building analytical tools that utilize the data pipeline.
• Support the wider business with their data needs on an ad hoc basis.
• Comply with QHSE (Quality Health Safety and Environment), Business Continuity, Information Security, Privacy, Risk, Compliance Management and Governance of Organizations policies, procedures, plans and related risk assessments.

Qualifications

• Bachelor's degree in computer engineering, Computer Science, or Electrical Engineering and Computer Sciences.
• 6+ years of programming experience, solid coding skills in Python, Shell, and Java
• Good corporate capacity, good communication skills.
• Experience with Web crawling, cleaning.
• Experience with solution architecture, data ingestion, query optimization, data segregation, ETL, ELT, AWS, EC2, S3, SQS, lambda, Elastic Search, Redshift, CI/CD frameworks and workflows.
• Working knowledge of data platform concepts - data lake, data warehouse, ETL, big data processing (designing and supporting variety/velocity/volume), real time processing architecture for data platforms, scheduling and monitoring of ETL/ELT jobs
• PostgreSQL and programming (preferably Java, Python), proficiency in understanding data, entity relationships, structured & unstructured data, SQL and NoSQL databases
• Knowledge of best practice in optimizing columnar and distributed data processing system and infrastructure
• Experienced in designing and implementing dimensional modelling
• Knowledge of machine learning and data mining techniques in one or more areas of statistical modelling, text mining and information retrieval.