Data Pipelines & Warehouse Engineer

arabic; Riyadh; Presencial; SAR 180.000 - 320.000; Jornada completa

Descripción de la vacante

arabic is seeking an experienced Data Engineer to build and maintain pipelines that move data from operational systems into the data warehouse, and to design the warehouse models that dashboards and ML use cases rely on.

You will profile sources, implement ingestion and processing, ensure data quality and lineage, and work with business users to reconcile KPIs and support monthly progress reporting.

Formación

• Strong Python and SQL, used in production.
• Spark (Databricks or Hadoop) and BigQuery, and comfort with both data-lake and warehouse patterns.
• Hands-on experience with at least two of Talend, Informatica, NiFi and Denodo.
• Extracting and capturing changes from MS SQL Server, Oracle, MySQL and PostgreSQL.
• Ingesting from APIs, files (SFTP, Excel, CSV) and open data, in batch and streaming.
• Dimensional modelling: star schemas, conformed dimensions, slowly changing dimensions, and the ability to document models at conceptual, logical and physical level.
• Orchestration, monitoring, retries, data-quality checks and lineage.
• Profiling, reconciliation, defining KPIs with business users

Responsabilidades

• Profile new sources before you build: databases, APIs, files, open data, structured and unstructured.
• Build, schedule and monitor ingestion and processing pipelines in the tools the client already uses, and extend them where it makes sense.
• Design and build the warehouse models (star schemas, conformed dimensions) that dashboards and machine-learning use cases sit on.
• Put data-quality checks and lineage capture into every pipeline, and keep the conceptual, logical and physical model documentation current.
• Work with business owners to reconcile figures and define KPIs, and help write the monthly progress report.

Conocimientos

Python

SQL

Spark

BigQuery

Talend

Informatica

NiFi

Denodo

MS SQL Server

Oracle

MySQL

PostgreSQL

APIs

SFTP

Excel

CSV

dbt

Airflow

Herramientas

Databricks

Hadoop

Descripción del empleo

arabic is seeking an experienced Data Engineer to build and maintain pipelines that move data from operational systems into the data warehouse, and to design the warehouse models that dashboards and ML use cases rely on.

You will profile sources, implement ingestion and processing, ensure data quality and lineage, and work with business users to reconcile KPIs and support monthly progress reporting.