Spark Data Engineer: Lakehouse & Informatica Pro

Datamatics Technologies; Eastern Province; Sur place; SAR 220 000 - 320 000; Plein temps

Résumé du poste

Datamatics Technologies in Saudi Arabia is seeking a Data Engineer to design, build, and optimize data ingestion, transformation and consumption on a modern lakehouse platform. You will work with Spark-based development and Informatica integrations to support enterprise data workloads.

The role emphasizes scalable pipelines, data modeling with Iceberg and deployment collaboration with platform engineers to achieve reliable batch and real-time processing.

Qualifications

• Hands-on Spark development with PySpark and/or Scala Spark.
• Experience with Informatica Data Integration for enterprise data pipelines.
• Knowledge of Apache Iceberg for table formats and lakehouse modeling.
• Strong data modeling and SQL skills for warehousing concepts.
• Experience with version control and basic Python scripting is a plus.

Responsabilités

• Design and develop scalable data ingestion and transformation pipelines.
• Build and optimize Spark-based ETL/ELT workloads and maintain data models.
• Develop and manage datasets using Apache Iceberg tables.
• Implement and support data integration workflows using Informatica.
• Enable analytics through Denodo, Starburst and/or Dremio.
• Collaborate with Platform Engineers on deployment and operations.
• Ensure data quality, metadata and governance across pipelines.
• Support batch and near real-time processing requirements.
• Participate in migration, testing and production rollout efforts.
• Troubleshoot and optimize performance, reliability and scalability of pipelines.

Connaissances

Apache Spark

SQL & Data Modeling

ETL/ELT Development

Data Warehousing Concepts

Git Version Control

Python

Outils

Apache Iceberg

Informatica Data Integration

MinIO Object Storage

Denodo

Starburst / Dremio

Kafka / Streaming Technologies

Description du poste

Datamatics Technologies in Saudi Arabia is seeking a Data Engineer to design, build, and optimize data ingestion, transformation and consumption on a modern lakehouse platform. You will work with Spark-based development and Informatica integrations to support enterprise data workloads.

The role emphasizes scalable pipelines, data modeling with Iceberg and deployment collaboration with platform engineers to achieve reliable batch and real-time processing.