Senior Data Engineer (Apache NiFi, Airflow & Kafka) | Tentacle Tech | Selangor, Malaysia

Tentacle Tech; Selangor; Sur place; MYR 180 000 - 240 000; Plein temps

Résumé du poste

Tentacle Tech is seeking a Senior Data Engineer in Selangor, Malaysia, to own enterprise data lake modeling, ETL/ELT optimization, and scalable data warehousing. The role centers on NiFi, Airflow, Iceberg, and Kafka, with strong emphasis on reliability and sub-second streaming.

You will mentor the team, collaborate with banking stakeholders, and guide architecture and deployment runbooks. This is a renewable contract engagement with high technical visibility.

Qualifications

• 5–7 years of progressive hands-on data engineering and ETL architecture.
• Experience with enterprise big data systems and data lake/warehousing.
• Operational expertise in NiFi, Airflow, Iceberg, and Kafka in enterprise settings.

Responsabilités

• Architect, design, and govern enterprise-scale ETL/ELT data pipelines, streaming architectures, and data platforms.
• Lead distributed data orchestration and messaging with NiFi, Airflow, Iceberg, and Kafka.
• Develop automation scripts in Python, PowerShell, Bash, and YAML; mentor junior engineers.

Connaissances

Data architecture

ETL/ELT design

Streaming analytics

Python scripting

Linux administration

Stakeholder communication

Residency requirement

Formation

Bachelor’s or Master’s degree in CS/IT/SE/Data Analytics

Outils

Apache NiFi

Apache Airflow

Apache Iceberg

Apache Kafka

Description du poste

Position Summary

Driving executive technical leadership, enterprise data platform architecture, and real-time streaming analytics for a premier banking project in Selangor, Malaysia, Tentacle Tech is actively seeking an accomplished Senior Data Engineer for a renewable contract professional engagement. In this vital senior technical role, you will take full operational, architectural, and strategic ownership of enterprise data lake modeling, complex ETL/ELT pipeline optimization, and scalable data warehousing platforms utilizing Apache NiFi, Airflow, Iceberg, and Kafka. Bringing 5 to 7 years of progressive professional experience in advanced data engineering, you will empower top-tier banking institutions to achieve uncompromised data reliability, sub-second transaction streaming, and resilient enterprise analytics. This prestigious career opportunity offers top-tier remuneration, high technical visibility, and professional growth within a premier global IT staffing and digital consulting enterprise.

Detailed Job Description

As a Senior Data Engineer supporting Tentacle Tech on a renewable contract basis in Selangor, Malaysia, you will take full operational, tactical, and technical ownership of enterprise data architecture design, advanced ETL pipeline engineering, ELK stack log monitoring, and team technical mentoring. Your day-to-day responsibilities include architecting distributed data pipelines with Apache NiFi, Airflow, and Kafka, optimizing large-scale datasets on Apache Iceberg, scripting automation workflows in Python, PowerShell, Bash, and YAML, guiding junior engineers, collaborating with banking stakeholders, and interacting directly with technical recruiters like Saf Suhaimi.

Key Responsibilities

• Architect, design, develop, and govern enterprise-scale ETL/ELT data pipelines, streaming architectures, and banking data platforms.
• Lead the implementation of distributed data orchestration and messaging frameworks utilizing Apache NiFi, Apache Airflow, Apache Iceberg, and Kafka.
• Author advanced automation scripts, data ingestion frameworks, and transformation modules using Python, PowerShell, Bash, and YAML.
• Oversee Linux system performance tuning, network optimization, and high-availability configuration for mission-critical data platforms.
• Design and maintain sophisticated Data Lake architectures, enterprise data warehouses, and Slowing Changing Dimension (SCD) models.
• Implement and manage centralized log analysis and real-time monitoring solutions utilizing the ELK Stack (Elasticsearch, Logstash, Kibana).
• Provide expert technical escalation support, conduct rigorous code reviews, and mentor junior data engineering team members.
• Maintain meticulous architectural documentation, data governance policies, disaster recovery blueprints, and deployment runbooks.

Required Qualifications & Skills

• Bachelor’s or Master’s degree in Computer Science, Information Technology, Software Engineering, Data Analytics, or related discipline.
• Minimum of 5 to 7 years of progressive professional hands-on experience in advanced data engineering, ETL architecture, and big data systems.
• Strong, demonstrable operational expertise in Apache NiFi, Apache Airflow, Apache Iceberg, and Apache Kafka in enterprise settings.
• Comprehensive working knowledge and practical proficiency in Python, PowerShell, Bash, and YAML scripting.
• Deep practical experience in Linux systems administration, enterprise networking, and distributed data store optimization.
• Solid practical grasp of advanced Data Lake modeling, dimensional warehousing, and complex SCD data models.
• Exceptional analytical problem-solving aptitude, architectural vision, and professional stakeholder communication skills.
• Mandatory Malaysian citizenship or current legal residency in Malaysia for professional operations in Selangor.

Nice-to-Have Skills

• Professional certifications such as Certified Data Professional, AWS Certified Data Analytics, or Google Cloud Professional Data Engineer.
• Hands-on familiarity with cloud-native data platforms, container orchestration (Docker, Kubernetes), and CI/CD pipelines.
• Prior professional working experience in top-tier multinational banking institutions, central banks, or major fintech enterprises.
• Experience utilizing enterprise agile tracking platforms (Jira, Confluence) for engineering sprint governance.
• Active participation in open-source data engineering communities, conference speaking, or technical advisory boards.

Application Information

• Salary/Rate: Market Competitive / Senior Renewable Contract Banking Package
• Deadline: Open until filled (Urgent Selangor Senior Data Engineer Opening)
• Notice Period: Immediate to 30 Days Preferred
• Contract Duration: Renewable Contract / Full-Time Engagement (Selangor, Malaysia)