Senior Data Engineer - Real-Time Streaming & Data Lake Architect

Tech Junction Ltd; Selangor; On-site; MYR 180,000 - 240,000; Full time

Job summary

Tentacle Tech in Selangor, Malaysia seeks a Senior Data Engineer for a renewable contract engagement. You will own enterprise data lake modeling, ETL/ELT pipelines, ELK monitoring, and data warehousing, using NiFi, Airflow, Iceberg, and Kafka.

You will guide juniors, interact with stakeholders, and ensure data reliability for banking projects. Requirements include 5–7 years in data engineering, strong Linux and scripting skills, and a Malaysian residency.

Qualifications

• 5–7 years of data engineering and ETL architecture experience.
• Hands-on with NiFi, Airflow, Iceberg, and Kafka in enterprise settings.
• Proficient in Python, PowerShell, Bash, and YAML scripting.
• Strong Linux, networking, and data warehousing know-how.
• Malaysian citizenship or valid residency in Malaysia.

Responsibilities

• Architect, design, develop, and govern enterprise-scale ETL/ELT data pipelines, streaming architectures, and banking data platforms.
• Lead the implementation of distributed data orchestration and messaging frameworks utilizing NiFi, Airflow, Iceberg, and Kafka.
• Author automation scripts, data ingestion frameworks, and transformation modules using Python, PowerShell, Bash, and YAML.
• Oversee Linux system performance tuning, network optimization, and high-availability configuration for mission-critical data platforms.
• Design and maintain Data Lake architectures, data warehouses, and SCD data models.
• Implement and manage central log analysis and real-time monitoring via ELK Stack.
• Provide expert escalation support, conduct code reviews, and mentor junior engineers.
• Maintain architectural documentation, governance policies, disaster recovery blueprints, and deployment runbooks.

Skills

NiFi

Airflow

Iceberg

Kafka

Python

PowerShell

Bash

YAML

Linux

Data Lake

Data Warehousing

SCD Modeling

Stakeholder comms

Education

Bachelor's degree

Master's degree

Tools

Jira

Confluence

Docker

Kubernetes

Job description

Tentacle Tech in Selangor, Malaysia seeks a Senior Data Engineer for a renewable contract engagement. You will own enterprise data lake modeling, ETL/ELT pipelines, ELK monitoring, and data warehousing, using NiFi, Airflow, Iceberg, and Kafka.

You will guide juniors, interact with stakeholders, and ensure data reliability for banking projects. Requirements include 5–7 years in data engineering, strong Linux and scripting skills, and a Malaysian residency.