Senior Data Engineer: AI-Driven Lakehouse & ETL Pipelines

Maseera; Manama; On-site; BHD 16,000 - 23,000; Full time

Job summary

ARRAY is seeking a senior data engineer to design robust data models and semantic layers that power AI-driven analytics. You will build and orchestrate scalable ETL/ELT pipelines using Airflow and dbt, feeding cloud data warehouses and lakehouses.

The role includes managing relational and NoSQL databases, implementing data governance, and integrating workloads on a Kubernetes-native platform with AWS services.

Qualifications

• Bachelor's degree in Computer Science or a STEM-based subject.
• 5+ years of experience in data or software engineering.
• Strong SQL and Python (or Java) skills.
• Hands-on experience building ETL/ELT pipelines using orchestration tools such as Airflow.
• Experience with cloud data warehouses and lakehouse architectures (e.g., Snowflake, Redshift, BigQuery, Apache Iceberg, or Delta Lake).
• Strong database fundamentals — schema design, indexing, query optimization — across relational (PostgreSQL, MySQL, Oracle) and NoSQL systems.
• Experience with unstructured data stores (Vector DBs, Document DBs) supporting AI/ML retrieval use cases.
• Working knowledge of containerized environments (Docker, Kubernetes) for deploying data workloads.
• CI/CD pipeline experience (GitHub Actions, GitLab CI, Jenkins, or similar).
• Working knowledge of Infrastructure as Code (Terraform or similar).
• Proficiency with version control (Git).
• Strong written and verbal English communication skills.

Responsibilities

• Data Modelling: Design schemas and semantic layers (medallion bronze/silver/gold) that power AI-driven applications and analytics.
• ETL & Pipeline Architecture: Build and orchestrate ETL/ELT pipelines (batch and streaming) using Airflow and dbt, feeding cloud data warehouses and lakes.
• Lakehouse & Storage Architecture: Design and maintain data lake and lakehouse solutions using open table formats over object storage.
• Database Engineering: Manage relational and NoSQL databases supporting both transactional and analytical workloads.
• Data Governance: Implement RBAC, permission-aware retrieval, reconciliation, and data quality monitoring across data platforms.
• Cloud & Platform Integration: Deploy and operate data workloads on Kubernetes-native platform alongside core AWS services.

Skills

SQL

Python

Airflow

Cloud data warehouses

Lakehouse

PostgreSQL

MySQL

Oracle

NoSQL

Docker

Kubernetes

Terraform

Git

Education

Bachelor's degree in Computer Science or STEM

Tools

Airflow

dbt

Snowflake

Redshift

BigQuery

Apache Iceberg

Delta Lake

Kubernetes

Docker

Terraform

Job description

ARRAY is seeking a senior data engineer to design robust data models and semantic layers that power AI-driven analytics. You will build and orchestrate scalable ETL/ELT pipelines using Airflow and dbt, feeding cloud data warehouses and lakehouses.

The role includes managing relational and NoSQL databases, implementing data governance, and integrating workloads on a Kubernetes-native platform with AWS services.