Data Engineer: Spark, Iceberg & Informatica Expert

Datamatics-Global-Services-Ltd; Dammam; Presencial; SAR 240.000 - 420.000; Jornada completa

Descripción de la vacante

Datamatics-Global-Services-Ltd seeks a Data Engineer to design, build, and optimize data ingestion and transformation workloads on a modern on-prem lakehouse platform. You will work with Spark-based development and Informatica-based integration solutions to enable analytics and data consumption.

The role emphasizes data modeling with Iceberg tables, governance, and scalable pipelines. Experience with Denodo, Starburst, or Dremio is a plus, and on-prem data environments demand strong

Formación

• Proficiency with Spark (PySpark/Scala) and Iceberg data models.
• Informatica Data Integration for enterprise data pipelines.
• Experience with MinIO/object storage and data lake concepts.
• Experience with Denodo, Starburst and/or Dremio is a plus.
• Strong SQL, data modeling, and data warehousing concepts.
• ETL/ELT development and version control with Git.
• Hands-on data pipeline development and governance practices.
• Python and streaming technologies are advantageous.

Responsabilidades

• Design and develop scalable data ingestion and transformation pipelines.
• Build, optimize, and maintain Spark-based ETL/ELT workloads.
• Develop and manage data models and datasets using Apache Iceberg tables.
• Implement and support data integration workflows using Informatica.
• Enable analytics and data consumption through Denodo, Starburst, and/or Dremio.
• Develop secure, governed, and scalable data pipelines aligned with enterprise standards.
• Support batch and near real-time data processing requirements.
• Implement data quality, metadata management, and validation controls.
• Collaborate with Platform Engineers on deployment, integration, and operationalization activities.
• Support migration, testing, and production rollout initiatives.
• Troubleshoot and optimize data pipeline performance, reliability, and scalability.

Conocimientos

Apache Spark

Apache Iceberg

Informatica Data Integration

MinIO Storage

Denodo

SQL & Data Modeling

Data Warehousing

ETL/ELT

Git Version Control

Python

Kafka

Herramientas

Starburst

Dremio

Python

Kafka

Descripción del empleo

Datamatics-Global-Services-Ltd seeks a Data Engineer to design, build, and optimize data ingestion and transformation workloads on a modern on-prem lakehouse platform. You will work with Spark-based development and Informatica-based integration solutions to enable analytics and data consumption.

The role emphasizes data modeling with Iceberg tables, governance, and scalable pipelines. Experience with Denodo, Starburst, or Dremio is a plus, and on-prem data environments demand strong