Data Engineer (Apache NiFi, Airflow & Kafka) | Tentacle Tech | Selangor, Malaysia

Tech Junction Ltd; Selangor; On-site; MYR 90,000 - 150,000; Full time

Job summary

Tentacle Tech in Selangor, Malaysia, is seeking an accomplished Data Engineer for a renewable contract engagement. You will own end-to-end data pipeline development, data lake modelling, and performance tuning using NiFi, Airflow, Iceberg, and Kafka.

Requires 3–5 years in data engineering and financial systems, with strong scripting in Python/PowerShell/Bash/YAML. The role includes collaboration with cross-functional teams and ongoing professional growth within a premier IT consulting

Qualifications

• Bachelor's degree in Computer Science, IT, or related field.
• 3–5 years of data engineering, ETL/ELT development, and data warehousing experience.
• Proficient with NiFi, Airflow, Iceberg, Kafka, and scripting in Python/PowerShell/Bash/YAML.

Responsibilities

• Architect and develop robust ETL/ELT pipelines and data warehouses for banking platforms.
• Manage distributed data streaming, data integration, and workflow orchestration with NiFi, Airflow, Iceberg, and Kafka.
• Write clean automation and data transformation scripts in Python, PowerShell, Bash, and YAML.
• Configure Linux systems, networks, and big data environments.
• Design and maintain Data Lake and dimensional warehouses with SCD models.
• Monitor ELK logging and perform data lineage and deployment documentation.
• Troubleshoot data pipeline issues and optimize performance.
• Collaborate with banking squads and recruiters on delivery.

Skills

Data engineering

ETL/ELT development

Python

PowerShell

Bash

YAML

Linux administration

SCD data models

Education

Bachelor's degree in CS/IT

Tools

Apache NiFi

Apache Airflow

Apache Iceberg

Apache Kafka

ELK Stack

Job description

Position Summary

Driving advanced data engineering, enterprise data warehousing, and real-time data pipeline architecture for a premier banking project in Selangor, Malaysia, Tentacle Tech is actively seeking an accomplished Data Engineer for a renewable contract professional engagement. In this vital technical role, you will take full operational, tactical, and technical ownership of building, optimizing, and scaling robust ETL/ELT data pipelines utilizing Apache NiFi, Airflow, Iceberg, and Kafka. Bringing 3 to 5 years of progressive professional experience in data engineering and financial systems, you will empower top-tier banking institutions to achieve uncompromised data integrity, real-time transaction streaming, and scalable analytics. This prestigious career opportunity offers competitive remuneration, high technical visibility, and professional growth within a premier global IT staffing and digital consulting enterprise.

Detailed Job Description

As a Data Engineer supporting Tentacle Tech on a renewable contract basis in Selangor, Malaysia, you will take full operational, tactical, and technical ownership of data pipeline development, data lake modelling, log aggregation, and system performance tuning. Your day-to-day responsibilities include authoring complex ETL workflows in Python, PowerShell, and Bash, orchestrating data pipelines with Apache Airflow and NiFi, managing distributed streaming architectures via Apache Kafka and Iceberg, implementing Slowing Changing Dimension (SCD) data models, monitoring ELK stack logging environments, collaborating with multidisciplinary banking squads, and interacting directly with technical recruiters like Saf Suhaimi.

Key Responsibilities

• Architect, design, develop, test, and deploy robust ETL/ELT data pipelines and enterprise data warehousing architectures for banking platforms.
• Implement and manage distributed data streaming, data integration, and workflow orchestration utilizing Apache NiFi, Airflow, Iceberg, and Kafka.
• Author clean, maintainable, and highly efficient automation scripts and data transformation jobs utilizing Python, PowerShell, Bash, and YAML.
• Configure and administer Linux operating systems, network connectivity, and distributed computing environments for big data workloads.
• Design and maintain enterprise Data Lake architectures, dimensional data warehouses, and Slowing Changing Dimension (SCD) models.
• Administer and monitor log aggregation and real-time search analytics utilizing the ELK Stack (Elasticsearch, Logstash, Kibana).
• Troubleshoot complex data pipeline failures, latency bottlenecks, memory allocation errors, and data synchronization discrepancies.
• Maintain meticulous technical documentation, data lineage maps, architecture blueprints, and deployment runbooks.

Required Qualifications & Skills

• Bachelor’s degree in Computer Science, Information Technology, Software Engineering, Data Analytics, or related technical discipline.
• Minimum of 3 to 5 years of progressive professional hands‑on experience in data engineering, ETL/ELT development, and data warehousing.
• Strong, demonstrable operational expertise in Apache NiFi, Apache Airflow, Apache Iceberg, and Apache Kafka.
• Comprehensive working knowledge and practical proficiency in programming and scripting languages: Python, PowerShell, Bash, and YAML.
• Deep practical experience in Linux system administration, networking fundamentals, and distributed storage management.
• Solid practical grasp of Data Lake modelling, dimensional warehousing concepts, and SCD data models.
• Exceptional analytical problem‑solving aptitude, system debugging capabilities, and professional stakeholder communication skills.
• Mandatory Malaysian citizenship or current legal residency in Malaysia for professional operations in Selangor.

Nice-to-Have Skills

• Professional certifications such as Certified Data Engineer, Datacenter Professional, or AWS/Azure Data Analytics Specialty.
• Hands‑on familiarity with cloud data platforms, containerization (Docker, Kubernetes), and CI/CD deployment pipelines.
• Prior professional working experience in top‑tier multinational banking institutions, financial technology firms, or major system integrators.
• Experience utilizing enterprise agile tracking platforms (Jira, Confluence) for sprint execution and task coordination.
• Active participation in open‑source data engineering communities, Apache software foundations, or technical forums.

Application Information

• Salary/Rate: Market Competitive / Renewable Contract Banking Package
• Deadline: Open until filled (Urgent Selangor Data Engineer Opening)
• Notice Period: Immediate to 30 Days Preferred
• Contract Duration: Renewable Contract / Full‑Time Engagement (Selangor, Malaysia)