Senior Data Engineer - Spark, Iceberg & Lakehouse

Datamatics Technologies LLC; Al Jubayl; On-site; SAR 240,000 - 360,000; Full time

Job summary

Datamatics Technologies LLC is seeking a Data Engineer to design, build, and optimize data ingestion, transformation, and consumption workloads on a modern on-prem lakehouse platform. Candidates should have hands-on Spark development, Iceberg, and Informatica experience.

You will implement secure, governed data pipelines, enable analytics with Denodo, Starburst, or Dremio, and collaborate with Platform Engineers on deployment and testing across batch and near real-time processing.

Qualifications

• Apache Spark (PySpark and/or Scala Spark)
• Apache Iceberg
• Informatica Data Integration
• MinIO Object Storage
• Denodo
• SQL and Data Modeling
• Data Warehousing Concepts
• ETL/ELT Development
• Git Version Control

Responsibilities

• Design and develop scalable data ingestion and transformation pipelines.
• Build, optimize, and maintain Spark-based ETL/ELT workloads.
• Develop and manage data models and datasets using Apache Iceberg tables.
• Implement and support data integration workflows using Informatica.
• Enable analytics and data consumption through Denodo, Starburst, and/or Dremio.
• Develop secure, governed, and scalable data pipelines aligned with enterprise standards.
• Support batch and near real-time data processing requirements.
• Implement data quality, metadata management, and validation controls.
• Collaborate with Platform Engineers on deployment, integration, and operationalization activities.
• Support migration, testing, and production rollout initiatives.
• Troubleshoot and optimize data pipeline performance, reliability, and scalability.

Skills

Apache Spark

Apache Iceberg

Informatica Data Integration

MinIO Object Storage

Denodo

SQL and Data Modeling

Data Warehousing Concepts

ETL/ELT Development

Git Version Control

Tools

Git

Job description

Datamatics Technologies LLC is seeking a Data Engineer to design, build, and optimize data ingestion, transformation, and consumption workloads on a modern on-prem lakehouse platform. Candidates should have hands-on Spark development, Iceberg, and Informatica experience.

You will implement secure, governed data pipelines, enable analytics with Denodo, Starburst, or Dremio, and collaborate with Platform Engineers on deployment and testing across batch and near real-time processing.