Data Engineer — Informatica BDM & Spark Specialist

Systems Arabia; Manama; On-site; BHD 15,000 - 24,000; Full time

Job summary

Systems Arabia is seeking a Data Engineer with 4–7 years of hands-on experience to design, develop, and maintain scalable data integration solutions across enterprise platforms using Informatica BDM and Spark. You will build ETL/ELT pipelines, optimize Spark jobs, work with Hadoop/HDFS/Hive, and collaborate with Data Architects and Analysts to ensure data quality and performance.

Proficiency in PySpark, Linux scripting, and Git is valued.

Qualifications

• 4–7 years of hands-on experience in Data Engineering, ETL, or Big Data technologies.
• Strong hands-on experience with Informatica Big Data Management (BDM).
• Strong experience with Apache Spark; PySpark experience is highly preferred.
• Good understanding of Informatica mappings, workflows, transformations, and data integration processes.
• Strong SQL skills with experience in query development and performance optimization.
• Experience with Hadoop ecosystem technologies such as HDFS and Hive.
• Experience handling large-scale structured and unstructured datasets.
• Experience with batch data processing and distributed data processing.
• Good knowledge of Python/Scala for data processing and automation.
• Experience with Linux/Unix environments and shell scripting.
• Strong troubleshooting and performance-tuning skills.
• Understanding of data quality, data validation, and error-handling practices.
• Experience with version control tools such as Git.
• Good communication, analytical, and problem-solving skills.

Responsibilities

• Design, develop, and maintain data pipelines using Informatica BDM.
• Develop and optimize large-scale data processing workflows using Apache Spark/PySpark.
• Build robust ETL/ELT processes for batch and near-real-time data processing.
• Perform data extraction, transformation, cleansing, and loading from multiple source systems.
• Develop Informatica mappings, workflows, transformations, and reusable components.
• Work with Hadoop ecosystem technologies such as HDFS, Hive, and related components.
• Write and optimize Spark jobs for processing large volumes of structured and semi-structured data.
• Troubleshoot performance, data quality, and production issues across Informatica and Spark pipelines.
• Optimize ETL workflows, Spark jobs, SQL queries, and data processing performance.
• Collaborate with Data Architects, Data Analysts, and other engineering teams to implement data solutions.
• Implement data validation, reconciliation, error handling, and monitoring mechanisms.
• Participate in deployment, production support, and release activities.
• Follow data engineering best practices for scalability, reliability, security, and maintainability.
• Prepare technical documentation for data pipelines, mappings, workflows, and operational processes.

Skills

Data engineering

ETL/ELT

SQL

Python/Scala

Git

Troubleshooting

Tools

Informatica BDM

Apache Spark

PySpark

Hadoop (HDFS, Hive)

Linux/Unix scripting

Job description

Systems Arabia is seeking a Data Engineer with 4–7 years of hands-on experience to design, develop, and maintain scalable data integration solutions across enterprise platforms using Informatica BDM and Spark. You will build ETL/ELT pipelines, optimize Spark jobs, work with Hadoop/HDFS/Hive, and collaborate with Data Architects and Analysts to ensure data quality and performance.

Proficiency in PySpark, Linux scripting, and Git is valued.