Senior Data Engineer: Shape Scalable Lakehouse Platform

SmartChoice International GCC; Riyadh; On-site; SAR 420,000 - 640,000; Full time

Job summary

SmartChoice International GCC in Riyadh seeks a Senior Data Engineer to build and scale its data platform, owning data ingestion, processing, storage, modelling and governance across multiple applications.

You will design scalable pipelines, establish data architectures, ensure data quality and security, and work with engineering teams to optimise performance and costs as the platform evolves.

Qualifications

• 8+ years of professional data engineering experience.
• Strong Python and SQL with PySpark or comparable distributed processing.
• Experience with AWS data services and data lake/lakehouse architectures.

Responsibilities

• Design, build and operate scalable batch and streaming data pipelines.
• Develop data architecture across ingestion, processing, storage and transformation layers.
• Build reliable, reusable datasets and data models for downstream applications and teams.
• Implement data quality, validation, monitoring, lineage and governance.
• Design for reliability through idempotency, deduplication, schema evolution, recovery and historical accuracy.
• Implement access controls and protection for sensitive data.
• Collaborate with engineering and infrastructure teams to operate production data services.
• Optimize performance, scalability and infrastructure costs.
• Contribute to technical standards, documentation and code reviews.

Skills

Python

SQL

PySpark

Tools

S3

Glue

Glue Data Catalog

Athena

Redshift

Airbyte

Fivetran

Meltano

Kinesis

MSK

SQS

SNS

DMS

Debezium

dbt

Parquet

Iceberg

Delta Lake

Hudi

MWAA

Step Functions

Dagster

Prefect

Job description

SmartChoice International GCC in Riyadh seeks a Senior Data Engineer to build and scale its data platform, owning data ingestion, processing, storage, modelling and governance across multiple applications.

You will design scalable pipelines, establish data architectures, ensure data quality and security, and work with engineering teams to optimise performance and costs as the platform evolves.