Data Engineer

Prevail; United Arab Emirates; Hybrid; AED 150,000 - 200,000; Full time

Job summary

A data-driven firm in the UAE seeks a Data Engineer to enhance its data engineering capability. You will design data infrastructure, develop data pipelines, and ensure scalable solutions, focusing on the needs of mission teams. Ideal candidates should be proficient in Python and AWS. This role offers competitive tax-free income, health insurance, and flexible hybrid working arrangements.

Benefits

Health insurance

Flexible hybrid working arrangements

Competitive tax-free income

Work visa for the UAE

Qualifications

• Building and maintaining data pipelines with various AWS products.
• Designing data infrastructure for analytics and modeling.
• Strong experience in Python or similar programming languages.

Responsibilities

• Transform large datasets for rapid exploitation by mission teams.
• Identify and implement improvements to current data processes.
• Collaborate with teams to advocate for high-quality data solutions.

Skills

Building data pipelines

Snowflake

Python

Data modeling

Amazon Web Services (AWS)

ETL development

Tools

Apache Spark

Data Bricks

Terraform

Job description

Overview

We are looking for a Data Engineer to enhance our internal data engineering capability from the UAE and play a key role in developing the data infrastructure and systems alongside our UK Team, ensuring that our data pipelines are reliable, scalable, and efficient.

Reporting

Reporting into the Executive Director – Middle East, but working under the direction of the Head of Data & Spatial Intelligence, you will be responsible for designing data infrastructure to support modelling and data analytics, and work with stakeholders to understand their data needs and help design data solutions.

Technology

Competence and experience in Snowflake, Data Bricks and Python highly desirable.

Team and Working Style

The Technology team within Prevail underpins all of our mission focused teams. No two days are the same and the real-world problems we seek to solve are complicated. You will get the opportunity to interact with a wide range of datasets and support both the wider tech team and mission teams turning this data into insights to drive our customers decision making, with a focus on our Middle East customers. The team structure is flat with a network centric approach to leadership. A small team, we rely on strong communication and the ability to mutually support each other whilst working at pace.

Responsibilities & Deliverables

• Receiving large datasets and transforming them to enable our mission teams to rapidly exploit the data.
• Identifying improvements to our current data processes and implementing solutions.
• Implementing data flows to connect operational systems, data for analytics, and business intelligence systems.
• Creation and development of data pipelines.
• Documenting source-to-target mappings.
• Re-engineering manual data flows to enable scaling and repeatable use.
• Support the build of data streaming systems.
• Build and maintain ETL scripts and pipelines and code to ensure the ETL process performs optimally and ensures data is accurate and easy to use.
• Develop business intelligence reports that can be used for multiple audiences.
• Build accessible data for analysis.
• Automate data processing tasks and workflows.
• Collaborate with cross functional teams to advocate for high-quality data solutions.

What we Offer

• Health insurance as standard.
• Flexible hybrid working arrangements.
• Competitive tax-free income.
• Work visa for the UAE.

Qualifications

• Building, modelling, and maintaining data pipelines with a range of Amazon Web Services products and technologies such as EC2, S3, Lambda, ECS and Redshift.
• Designing data infrastructure to support modelling and data analytics.
• Strong Python experience or other object oriented or a functional programming language such as Java, Scala, C#, or R.
• Data warehousing – building operation ETL data pipelines across several sources, and constructing relation and dimensional data models.
• Built and maintained scalable infrastructure through IaC frameworks (e.g., Terraform, CloudFormation) and CI/CD workflows.
• Familiarity with Apache Spark or Databricks.
• Excellent communication and collaboration skills.
• Geospatial data exposure is advantageous but not a requirement.

EEO Statement

Prevail is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, or any other protected characteristic.