Senior Data Engineer (Apache NiFi, Airflow & Kafka) | Tentacle Tech | Selangor, Malaysia

Tech Junction Ltd; Selangor; On-site; MYR 180,000 - 240,000; Full time

Job summary

Tentacle Tech in Selangor, Malaysia seeks a Senior Data Engineer for a renewable contract engagement. You will own enterprise data lake modeling, ETL/ELT pipelines, ELK monitoring, and data warehousing, using NiFi, Airflow, Iceberg, and Kafka.

You will guide juniors, interact with stakeholders, and ensure data reliability for banking projects. Requirements include 5–7 years in data engineering, strong Linux and scripting skills, and a Malaysian residency.

Qualifications

• 5–7 years of data engineering and ETL architecture experience.
• Hands-on with NiFi, Airflow, Iceberg, and Kafka in enterprise settings.
• Proficient in Python, PowerShell, Bash, and YAML scripting.
• Strong Linux, networking, and data warehousing know-how.
• Malaysian citizenship or valid residency in Malaysia.

Responsibilities

• Architect, design, develop, and govern enterprise-scale ETL/ELT data pipelines, streaming architectures, and banking data platforms.
• Lead the implementation of distributed data orchestration and messaging frameworks utilizing NiFi, Airflow, Iceberg, and Kafka.
• Author automation scripts, data ingestion frameworks, and transformation modules using Python, PowerShell, Bash, and YAML.
• Oversee Linux system performance tuning, network optimization, and high-availability configuration for mission-critical data platforms.
• Design and maintain Data Lake architectures, data warehouses, and SCD data models.
• Implement and manage central log analysis and real-time monitoring via ELK Stack.
• Provide expert escalation support, conduct code reviews, and mentor junior engineers.
• Maintain architectural documentation, governance policies, disaster recovery blueprints, and deployment runbooks.

Skills

NiFi

Airflow

Iceberg

Kafka

Python

PowerShell

Bash

YAML

Linux

Data Lake

Data Warehousing

SCD Modeling

Stakeholder comms

Education

Bachelor's degree

Master's degree

Tools

Jira

Confluence

Docker

Kubernetes

Job description

Position Summary

Driving executive technical leadership, enterprise data platform architecture, and real-time streaming analytics for a premier banking project in Selangor, Malaysia, Tentacle Tech is actively seeking an accomplished Senior Data Engineer for a renewable contract professional engagement. In this vital senior technical role, you will take full operational, architectural, and strategic ownership of enterprise data lake modeling, complex ETL/ELT pipeline optimization, and scalable data warehousing platforms utilizing Apache NiFi, Airflow, Iceberg, and Kafka. Bringing 5 to 7 years of progressive professional experience in advanced data engineering, you will empower top-tier banking institutions to achieve uncompromised data reliability, sub-second transaction streaming, and resilient enterprise analytics. This prestigious career opportunity offers top-tier remuneration, high technical visibility, and professional growth within a premier global IT staffing and digital consulting enterprise.

Detailed Job Description

As a Senior Data Engineer supporting Tentacle Tech on a renewable contract basis in Selangor, Malaysia, you will take full operational, tactical, and technical ownership of enterprise data architecture design, advanced ETL pipeline engineering, ELK stack log monitoring, and team technical mentoring. Your day-to-day responsibilities include architecting distributed data pipelines with Apache NiFi, Airflow, and Kafka, optimizing large-scale datasets on Apache Iceberg, scripting automation workflows in Python, PowerShell, Bash, and YAML, guiding junior engineers, collaborating with banking stakeholders, and interacting directly with technical recruiters like Saf Suhaimi.

Key Responsibilities

• Architect, design, develop, and govern enterprise-scale ETL/ELT data pipelines, streaming architectures, and banking data platforms.
• Lead the implementation of distributed data orchestration and messaging frameworks utilizing Apache NiFi, Apache Airflow, Apache Iceberg, and Kafka.
• Author advanced automation scripts, data ingestion frameworks, and transformation modules using Python, PowerShell, Bash, and YAML.
• Oversee Linux system performance tuning, network optimization, and high-availability configuration for mission-critical data platforms.
• Design and maintain sophisticated Data Lake architectures, enterprise data warehouses, and Slowing Changing Dimension (SCD) models.
• Implement and manage centralized log analysis and real-time monitoring solutions utilizing the ELK Stack (Elasticsearch, Logstash, Kibana).
• Provide expert technical escalation support, conduct rigorous code reviews, and mentor junior data engineering team members.
• Maintain meticulous architectural documentation, data governance policies, disaster recovery blueprints, and deployment runbooks.

Required Qualifications & Skills

• Bachelor's or Master's degree in Computer Science, Information Technology, Software Engineering, Data Analytics, or related discipline.
• Minimum of 5 to 7 years of progressive professional hands-on experience in advanced data engineering, ETL architecture, and big data systems.
• Strong, demonstrable operational expertise in Apache NiFi, Apache Airflow, Apache Iceberg, and Apache Kafka in enterprise settings.
• Comprehensive working knowledge and practical proficiency in Python, PowerShell, Bash, and YAML scripting.
• Deep practical experience in Linux systems administration, enterprise networking, and distributed data store optimization.
• Solid practical grasp of advanced Data Lake modeling, dimensional warehousing, and complex SCD data models.
• Exceptional analytical problem-solving aptitude, architectural vision, and professional stakeholder communication skills.
• Mandatory Malaysian citizenship or current legal residency in Malaysia for professional operations in Selangor.

Nice-to-Have Skills

• Professional certifications such as Certified Data Professional, AWS Certified Data Analytics, or Google Cloud Professional Data Engineer.
• Hands-on familiarity with cloud-native data platforms, container orchestration (Docker, Kubernetes), and CI/CD pipelines.
• Prior professional working experience in top-tier multinational banking institutions, central banks, or major fintech enterprises.
• Experience utilizing enterprise agile tracking platforms (Jira, Confluence) for engineering sprint governance.
• Active participation in open-source data engineering communities, conference speaking, or technical advisory boards.

Application Information

• Recruiter: Tentacle Tech Recruitment Division
• Contact Name: Saf Suhaimi (Technical Recruiter)
• Email: [e-mail]
• Phone / WhatsApp: [phone]
• Company Website: https://www.tentacletech.com
• Salary/Rate: Market Competitive / Senior Renewable Contract Banking Package
• Deadline: Open until filled (Urgent Selangor Senior Data Engineer Opening)
• Notice Period: Immediate to 30 Days Preferred
• Contract Duration: Renewable Contract / Full-Time Engagement (Selangor, Malaysia)