Senior Spark Data Engineer for Lakehouse Pipelines

Datamatics Technologies LLC; Riyadh; On-site; SAR 180,000 - 240,000; Full time

Job summary

Datamatics Technologies LLC is seeking a Data Engineer to design, implement, and optimize data ingestion, transformation, and consumption workloads on a modern on-prem lakehouse platform. You will work with Spark-based development, Iceberg tables, and Informatica integration solutions.

The ideal candidate has hands-on experience with Spark, data lakehouse implementations, and Informatica-based integration. Strong collaboration with platform engineers and governance-focused mindset are essential.

Qualifications

• Hands-on Spark development experience (PySpark/Scala).
• Experience with Iceberg tables and SQL/data modeling.
• Proficient in Informatica Data Integration and data pipelines.
• Experience with MinIO object storage and data lakehouse concepts.
• Familiarity with Denodo/Starburst/Dremio for analytics.
• Knowledge of data warehousing concepts and ETL/ELT development.
• Version control with Git.

Responsibilities

• Design and build scalable ingestion and transformation pipelines.
• Develop and optimize Spark-based ETL/ELT workloads.
• Model datasets using Apache Iceberg tables.
• Implement and support Informatica workflows.
• Enable analytics via Denodo/Starburst/Dremio.
• Ensure data quality, metadata governance and controls.
• Collaborate with Platform Engineers on deployment and operations.
• Support migration, testing and production rollout.
• Troubleshoot and optimize pipeline performance and scalability.

Skills

Apache Spark

PySpark

Scala Spark

Apache Iceberg

Informatica Data Integration

MinIO Object Storage

Denodo

SQL

Data Modeling

Data Warehousing Concepts

ETL/ELT Development

Git Version Control

Tools

Informatica Data Integration

Denodo

Git

Job description

Datamatics Technologies LLC is seeking a Data Engineer to design, implement, and optimize data ingestion, transformation, and consumption workloads on a modern on-prem lakehouse platform. You will work with Spark-based development, Iceberg tables, and Informatica integration solutions.

The ideal candidate has hands-on experience with Spark, data lakehouse implementations, and Informatica-based integration. Strong collaboration with platform engineers and governance-focused mindset are essential.