Senior Data Engineer: Scalable Pipelines & Real-Time Data

BBI; Riyadh Region; On-site; SAR 180,000 - 320,000; Full time

Job summary

BBI is seeking a seasoned Data Engineer to design, develop, and maintain scalable data pipelines for large datasets in a Saudi Arabia setting. You will orchestrate batch and near-real-time data flows, evaluate new tools, and optimize data systems for performance and reliability.

The role requires 5+ years in data engineering, strong Python, UNIX CLI skills, and expertise with Airflow, DBT, Hadoop, Spark, Hive, Kafka, and SQL. Knowledge of data modeling and warehousing is essential.

Qualifications

• Bachelor’s or Master’s degree in CS/DS or related field.
• 5+ years of experience as a Data Engineer or similar role.
• Strong Python programming skills.
• Experience with UNIX command-line administration.
• Experience with Airflow, Airbyte, DBT, Hadoop, Spark, Hive, and Kafka; SQL and relational databases.
• Knowledge of data modeling, ETL processes, and data warehousing solutions.
• Knowledge of structuring data for data lakes, warehouses, or marts.
• Experience with scalable storage solutions like PostgreSQL and MinIO.
• Experience in improving performance of big data applications.

Responsibilities

• Design, develop, and maintain scalable data pipelines for large datasets.
• Orchestrate data flows for batch and near-real-time processing.
• Evaluate and deploy big data tools relevant to development.
• Identify platforms and methodologies used across the organization.
• Optimize and tune data systems for performance and reliability.
• Develop data models and schemas to support BI and analytics.
• Monitor and troubleshoot data pipelines for smooth operation.
• Document architectures and follow best practices.

Skills

Python

SQL

Big data dev

UNIX CLI

Data modeling

ETL

Data warehousing

Performance tuning

Data structures

Education

Bachelor's or Master's in Computer Science/Data Science

Tools

Airflow

Airbyte

DBT

Hadoop

Spark

Hive

Kafka

PostgreSQL

MinIO

Job description

BBI is seeking a seasoned Data Engineer to design, develop, and maintain scalable data pipelines for large datasets in a Saudi Arabia setting. You will orchestrate batch and near-real-time data flows, evaluate new tools, and optimize data systems for performance and reliability.

The role requires 5+ years in data engineering, strong Python, UNIX CLI skills, and expertise with Airflow, DBT, Hadoop, Spark, Hive, Kafka, and SQL. Knowledge of data modeling and warehousing is essential.