Data Engineer

Datamatics Technologies; Eastern Province; Vor Ort; SAR 220.000 - 320.000; Vollzeit

Zusammenfassung

Datamatics Technologies in Saudi Arabia is seeking a Data Engineer to design, build, and optimize data ingestion, transformation and consumption on a modern lakehouse platform. You will work with Spark-based development and Informatica integrations to support enterprise data workloads.

The role emphasizes scalable pipelines, data modeling with Iceberg and deployment collaboration with platform engineers to achieve reliable batch and real-time processing.

Qualifikationen

• Hands-on Spark development with PySpark and/or Scala Spark.
• Experience with Informatica Data Integration for enterprise data pipelines.
• Knowledge of Apache Iceberg for table formats and lakehouse modeling.
• Strong data modeling and SQL skills for warehousing concepts.
• Experience with version control and basic Python scripting is a plus.

Aufgaben

• Design and develop scalable data ingestion and transformation pipelines.
• Build and optimize Spark-based ETL/ELT workloads and maintain data models.
• Develop and manage datasets using Apache Iceberg tables.
• Implement and support data integration workflows using Informatica.
• Enable analytics through Denodo, Starburst and/or Dremio.
• Collaborate with Platform Engineers on deployment and operations.
• Ensure data quality, metadata and governance across pipelines.
• Support batch and near real-time processing requirements.
• Participate in migration, testing and production rollout efforts.
• Troubleshoot and optimize performance, reliability and scalability of pipelines.

Kenntnisse

Apache Spark

SQL & Data Modeling

ETL/ELT Development

Data Warehousing Concepts

Git Version Control

Python

Tools

Apache Iceberg

Informatica Data Integration

MinIO Object Storage

Denodo

Starburst / Dremio

Kafka / Streaming Technologies

Jobbeschreibung

Employment Type Full-Time

Work Location KSA

Experience Required Hands-on experience with Spark development Informatica integration solutions and enterprise data platforms Years of experience 5 to 10

Role Overview

We are looking for a Data Engineer to build configure and optimize data ingestion transformation and consumption workloads on a modern on-premises lakehouse platform The ideal candidate will have strong hands-on experience with Spark-based development enterprise data lake lakehouse implementations and Informatica-based integration solutions

Key Responsibilities

• Design and develop scalable data ingestion and transformation pipelines
• Build and optimize and maintain Spark-based ETL ELT workloads
• Develop and manage data models and datasets using Apache Iceberg tables
• Implement and support data integration workflows using Informatica
• Enable analytics and data consumption through Denodo Starburst and or Dremio
• Develop secure governed and scalable data pipelines aligned with enterprise standards
• Support batch and near real-time data processing requirements
• Implement data quality metadata management and validation controls
• Collaborate with Platform Engineers on deployment integration and operationalization activities
• Support migration testing and production rollout initiatives
• Troubleshoot and optimize data pipeline performance reliability and scalability

Must-Have Skills

• Apache Spark (PySpark and/or Scala Spark)
• Apache Iceberg
• Informatica Data Integration
• MinIO Object Storage
• Denodo
• SQL and Data Modeling
• Data Warehousing Concepts
• ETL/ELT Development
• Git Version Control

Good‑to‑Have Skills

• Starburst and/or Dremio
• Data Governance and Metadata Management
• Data Quality Frameworks
• CI/CD for Data Pipelines
• Python
• Kafka or Streaming Technologies
• Lakehouse Architecture Patterns
• Experience with enterprise data lake and lakehouse implementations
• Performance tuning and optimization of large-scale data workloads