Data Engineer

Clover Infotech; Dubai; On-site; AED 120,000 - 200,000; Full time

Job summary

An established industry player is seeking a Senior Big Data Engineer with expertise in Informatica Big Data Management and the Hadoop ecosystem. This role involves designing and developing scalable ETL pipelines, ensuring data security, and collaborating with teams to troubleshoot distributed system issues. The ideal candidate will have a strong background in data integration and will thrive in a dynamic environment, particularly within banking or financial services. Join a forward-thinking team where your skills will directly contribute to innovative data solutions and drive the success of critical projects.

Qualifications

• 4+ years of experience in Informatica Big Data Management required.
• Strong knowledge of the Hadoop ecosystem and data security.

Responsibilities

• Design and maintain scalable ETL pipelines using Informatica BDM.
• Implement data partitioning and distributed data processing strategies.

Skills

Informatica Big Data Management

Hadoop ecosystem (Hive, HDFS, Oozie)

SQL databases

NoSQL databases

Linux OS

Shell scripting

DevOps tools (Jenkins, GitHub)

Data security and compliance

Job description

Work Location: - Dubai
Mode of hiring: - Permanent.

Job Description: -

We are looking for a highly skilled Senior Big Data Engineer with a strong background in Informatica Big Data Management, Big Data technologies, and data security to join our technology team. The ideal candidate should have experience in data integration, distributed systems, and secure data handling within enterprise environments, preferably in banking or financial services.

Key Responsibilities:

• Design, develop, and maintain scalable ETL pipelines using Informatica BDM.
• Work with HDFS, Hive, Oozie, HQL for managing and processing large datasets.
• Implement data partitioning, storage optimization, and distributed data processing strategies.
• Develop solutions using SQL and NoSQL databases.
• Write efficient Linux shell scripts for data orchestration and job automation.
• Ensure adherence to security and compliance requirements including data encryption, anonymization, and secure logging.
• Collaborate with teams to troubleshoot distributed system issues and ensure resiliency in production environments.
• Follow Agile and DevOps best practices (CI/CD, GitHub, Jenkins).

Required Skills:

• 4+ years of experience in Informatica Big Data Management.
• Strong knowledge of the Hadoop ecosystem (Hive, HDFS, Oozie).
• Proficiency in SQL & NoSQL databases.
• Experience with Linux OS, shell scripting, and DevOps tools (Jenkins, GitHub).
• Understanding of data security, compliance, and network basics (DNS, Proxy, ACL).
• Familiarity with design patterns and secure application development.

Preferred:

• Experience in banking, financial services, or fintech environments.
• Excellent interpersonal and communication skills.
• Ability to lead discussions and influence multiple teams technically.