Senior Data Engineer - (GCP & Lakehouse Architecture) - On Site - Octopus by RTG

robusta

Riyadh

On-site

SAR 300,000 - 480,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

robusta seeks a Senior Data Engineer to design and implement an enterprise-grade Lakehouse on Google Cloud Platform, using BigQuery, Iceberg, Spark, and related technologies. You will build scalable pipelines and collaborate with data scientists and product teams to deliver production-ready data products.

The role emphasizes CI/CD for data pipelines, data quality, and strong SQL-based analytics across large datasets in a fast-paced environment.

Qualifications

  • 3+ years of hands-on experience designing and implementing enterprise-grade data platforms and pipelines.
  • GCP core data services experience (BigQuery, Cloud Storage, Dataflow/Dataproc, IAM).
  • Deep understanding of lakehouse concepts and hands-on Apache Iceberg experience.
  • Advanced proficiency in dbt for pipeline transformations and Airflow for workflow orchestration.
  • Strong SQL skills and data warehousing knowledge for high-performance analytics.

Responsibilities

  • Lakehouse Architecture & Development: Design, deploy, and maintain a scalable GCP-based Lakehouse ecosystem leveraging Apache Iceberg for transactional consistency and time-travel.
  • Pipeline Engineering: Build and optimize ETL/ELT data pipelines using Python and Airflow.
  • Big Data Processing: Implement large-scale distributed data processing with Apache Spark.
  • Data Warehousing & Analytics: Leverage BigQuery for high-performance analytical queries and data serving.
  • Transformation & Quality: Develop modular transformation code using dbt with automated data testing and lineage.
  • Data Modeling: Lead dimensional modeling (Star/Snowflake) and Lakehouse medallion architectures.
  • Performance Tuning & SQL Mastery: Write and optimize complex SQL queries for low latency.
  • Collaboration: Work with data scientists, analytics, and product managers to deliver robust data products.

Skills

Python
SQL
dbt
Airflow
Spark
BigQuery

Tools

Apache Airflow
dbt
Apache Spark
Iceberg
BigQuery

Job description

Key Responsibilities
  • Lakehouse Architecture & Development: Design, deploy, and maintain a scalable GCP-based Lakehouse ecosystem leveraging Apache Iceberg for transactional consistency, time-travel, and efficient storage management.
  • Pipeline Engineering: Architect, build, and optimize high-throughput ETL/ELT data pipelines using Python and Apache Airflow for orchestrating complex dependency workflows.
  • Big Data Processing: Implement large-scale distributed data processing workloads and transformation pipelines using Apache Spark.
  • Data Warehousing & Analytics: Leverage BigQuery for high-performance analytical queries, cost optimization, partition/cluster management, and serving structured data to downstream consumers.
  • Transformation & Quality: Write clean, modular, and testable transformation code using dbt (Data Build Tool), embedding automated data testing, documentation,and lineage tracking.
  • Data Modeling: Lead dimensional and semantic data modeling efforts (Star/Snowflake schemas, One-Big-Table, and Lakehouse medallion architectures) to ensure high query performance and seamless business usability.
  • Performance Tuning & SQL Mastery: Write, optimize, and troubleshoot complex SQL queries to ensure low latency and cost-efficient processing across large datasets.
  • Collaboration: Partner closely with data scientists, analytics teams, and product managers to understand data requirements and deliver robust, production-ready data products.

3+ years of hands-on experience designing and implementing enterprise-grade data platforms and pipelines.

  • Cloud Platform: Proven production experience with Google Cloud Platform (GCP) core data services (BigQuery, Cloud Storage, Dataflow/Dataproc, IAM).
  • Lakehouse & Table Formats: Deep understanding of modern lakehouse concepts and hands-on experience with Apache Iceberg.
  • Transformation & Orchestration: Advanced proficiency in dbt for pipeline transformations and Apache Airflow for workflow orchestration.
  • Big Data & Compute: Strong working knowledge of Apache Spark for distributed data processing.
Programming & Querying
  • Advanced Python programming skills for data engineering tasks and custom operator development.
  • Expert-level SQL writing and performance tuning capabilities.

Data Modeling: Demonstrated expertise in dimensional modeling, data warehousing concepts, and schema design for analytical workloads.

Methodologies: Strong grasp of modern ETL/ELT design patterns, CI/CD for data pipelines, data governance, and data quality best practices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer: Lakehouse, Spark & GCP
Senior Data Engineer: Lakehouse, Spark & GCP

robusta • Riyadh

On-site
SAR 300,000 - 480,000
Data Engineer Consultant
Data Engineer Consultant

Total-TECH Co. • Jeddah

On-site
SAR 150,000 - 210,000
Technical Lead
Technical Lead

Evolvice • Riyadh

Hybrid
SAR 350,000 - 550,000
Senior Data Engineer
Senior Data Engineer

SmartChoice International GCC • Riyadh

On-site
SAR 320,000 - 520,000
Senior Data Engineer
Senior Data Engineer

Devsinc, LLC • Riyadh

On-site
SAR 240,000 - 420,000
Associate Director - Data Engineering
Associate Director - Data Engineering

Jobskey Search and Selection • Riyadh

On-site
SAR 520,000 - 750,000
Senior Data Engineer
Senior Data Engineer

Maximus Gulf Recruitment Company LLC • Riyadh

On-site
SAR 300,000 - 450,000
Data Engineer
Data Engineer

DataPlus • Riyadh

Hybrid
SAR 120,000 - 160,000
Flexible hours
Remote work options
Opportunities for skill development
Data Engineer
Data Engineer

arabic • Riyadh

On-site
SAR 180,000 - 320,000
Data Engineer
Data Engineer

Arabic.AI • Riyadh

On-site
SAR 180,000 - 240,000