Senior Spark Data Engineer - Lakehouse & Informatica Expert

Datamatics Technologies; Al Jubayl; Vor Ort; SAR 170.000 - 300.000; Vollzeit

Zusammenfassung

Datamatics Technologies is seeking a Data Engineer to build and optimize data ingestion, transformation, and consumption workloads on a modern on-premises lakehouse platform. The role emphasizes Spark-based development, Iceberg tables, and Informatica-based integration.

You will collaborate with Platform Engineers to deploy, test, and operationalize data pipelines, while ensuring data quality and governance across enterprise environments.

Qualifikationen

• Hands-on Spark development experience (PySpark/Scala).
• Experience with Apache Iceberg and data lakehouse concepts.
• Proficiency in Informatica Data Integration for enterprise workloads.
• Experience with MinIO Object Storage for data assets.
• Familiarity with Denodo for data virtualization and analytics.
• Strong SQL skills and data modeling for warehousing.
• Understanding of data warehousing concepts and ETL/ELT.
• Version control using Git in data pipelines and deployments.

Aufgaben

• Design and develop scalable data ingestion and transformation pipelines.
• Build, optimize, and maintain Spark-based ETL/ELT workloads.
• Develop and manage data models and datasets using Iceberg tables.
• Implement and support data integration workflows using Informatica.
• Enable analytics through Denodo, Starburst, and/or Dremio.
• Develop secure, governed, and scalable data pipelines.
• Support batch and near real-time data processing.
• Implement data quality, metadata management, and validation controls.
• Collaborate with Platform Engineers on deployment and integration.
• Support migration, testing, and production rollout initiatives.
• Troubleshoot and optimize pipeline performance and scalability.

Kenntnisse

Spark (PySpark/Scala)

Apache Iceberg

Informatica Data Integration

MinIO Object Storage

Denodo

SQL & Data Modeling

Data Warehousing Concepts

ETL/ELT Development

Git Version Control

Tools

Starburst

Dremio

Data Governance

Data Quality Frameworks

CI/CD for Data Pipelines

Python

Kafka

Lakehouse Architecture Patterns

Jobbeschreibung

Datamatics Technologies is seeking a Data Engineer to build and optimize data ingestion, transformation, and consumption workloads on a modern on-premises lakehouse platform. The role emphasizes Spark-based development, Iceberg tables, and Informatica-based integration.

You will collaborate with Platform Engineers to deploy, test, and operationalize data pipelines, while ensuring data quality and governance across enterprise environments.