Spark Data Engineer — Lakehouse & Data Integration

Datamatics Technologies LLC; Karachi Division; On-site; PKR 22,155,000 - 36,001,000; Full time

Job summary

Datamatics Technologies LLC is seeking a Data Engineer to build, configure, and optimize ingestion, transformation, and consumption workloads on a modern on-premises lakehouse platform.

The ideal candidate will have hands-on Spark development experience, enterprise data lake/lakehouse implementations, and Informatica-based integration solutions to support analytics and data consumption through Denodo, Starburst, and Dremio.

Qualifications

• Hands-on Spark development experience.
• Experience with Informatica integration solutions.
• Strong on enterprise data platforms and lakehouse concepts.

Responsibilities

• Design and develop scalable data ingestion and transformation pipelines.
• Build, optimize, and maintain Spark-based ETL/ELT workloads.
• Develop and manage data models and datasets using Apache Iceberg tables.
• Implement and support data integration workflows using Informatica.
• Enable analytics and data consumption through Denodo, Starburst, and/or Dremio.
• Develop secure, governed, and scalable data pipelines aligned with enterprise standards.
• Support batch and near real-time data processing requirements.
• Implement data quality, metadata management, and validation controls.
• Collaborate with Platform Engineers on deployment, integration, and operationalization activities.
• Support migration, testing, and production rollout initiatives.
• Troubleshoot and optimize data pipeline performance, reliability, and scalability.

Tools

Apache Spark (PySpark/Scala)

Apache Iceberg

Informatica Data Integration

MinIO Object Storage

Denodo

SQL and Data Modeling

Data Warehousing Concepts

ETL/ELT Development

Git Version Control

Job description

Datamatics Technologies LLC is seeking a Data Engineer to build, configure, and optimize ingestion, transformation, and consumption workloads on a modern on-premises lakehouse platform.

The ideal candidate will have hands-on Spark development experience, enterprise data lake/lakehouse implementations, and Informatica-based integration solutions to support analytics and data consumption through Denodo, Starburst, and Dremio.