Data Engineer

Tentacle Tech; Bandar Baru Bangi; On-site; MYR 120,000 - 180,000; Full time

Job summary

Tentacle Tech is seeking a Data Engineer to join on a contract basis, onsite in Malaysia, to own data mapping and the development of Enterprise Data Lake pipelines across Bronze, Silver and Gold layers for a finance-sector project.

You will design, develop, test and implement robust data workflows using NiFi, Airflow, Kafka, and Iceberg, with Python and SQL on Linux environments. The role offers hands-on delivery with mentoring and growth opportunities.

Qualifications

• 3–5 years of experience in data engineering
• Experience with data lakes and ETL pipelines
• Familiarity with Linux, scripting and networking systems

Responsibilities

• Design, build and maintain end-to-end ETL/ELT pipelines, from sourcing to final data product delivery
• Design warehouse schemas and analytical models
• Clean, preprocess and transform data to create data products and load them for analytics
• Integrate data from multiple sources into centralised platforms for analytics and reporting
• Build frameworks for data validation, monitoring and error handling
• Prepare documentation covering data mapping and technical specifications

Skills

ETL development

Data warehousing

Data modeling

Python

SQL

Education

Bachelor's or Master’s degree in Engineering, Computer Science, IT or related

Tools

NiFi

Airflow

Apache Iceberg

Kafka

Job description

Tentacle Tech is an IT and software development consulting company serving some of Malaysia's largest enterprises. We deliver technology solutions, software development services, and IT consulting across multiple industries. We are looking for a talented professional to join our growing team.

The Role

We are seeking a Data Engineer to join us on a contract basis, working onsite on a data-driven project in the finance sector. You will take ownership of data mapping, design, development, testing and implementation for Enterprise Data Lake pipelines across the Bronze, Silver and Gold layers, delivering high-quality data products on time. If you enjoy building robust, automated data workflows and working with modern streaming and orchestration tools, this is a great opportunity to make a real impact.

What You'll Do

• Design, build and maintain end-to-end ETL/ELT pipelines, from sourcing to final data product delivery, for structured and unstructured data
• Design warehouse schemas and analytical models for implementation
• Clean, preprocess and transform data to create and load data products, while providing recommendations that improve productivity and business performance
• Integrate data from multiple sources into centralised platforms for analytics and reporting, including API integration with internal and external applications and Kafka for real-time streaming
• Build frameworks and programs for data validation, monitoring and error handling
• Prepare documentation covering data mapping, technical specifications, SIT plans and test cases

What We're Looking For

• 3 to 5 years of experience in data engineering, ETL and data warehousing
• Bachelor's or Master's degree in Engineering, Computer Science, IT or a related technical field
• Hands-on experience with NiFi, Airflow, Apache Iceberg and Kafka
• Proficiency in Python, PowerShell, Bash and YAML, with a solid Linux and networking foundation
• Strong understanding of Data Warehousing, Data Lake modeling, SCD data models and the ELK stack
• Advantageous: exposure to AWS, Azure or GCP, Docker, Kubernetes, MongoDB, HBase or PostgreSQL, and a Data Engineering certification

What We Offer

• Opportunity to work on a large-scale Enterprise Data Lake project in the finance sector
• Training and upskilling opportunities to keep your skills current
• Mentorship and career progression within a growing consulting company
• A supportive, collaborative team environment

Tentacle Technologies was founded in November 2001 with humble beginnings. Headquartered in Malaysia, today we operate in countries like Singapore, India and the Philippines. Our core services are Business Consulting, Software Development, Quality Assurance & IT solutions in Digital Transformation. We are techies with the right techniques to revamp businesses!

Unlike most of the tech companies that have been around since 2000’s, Tentacle Technologies understands the evolution of technology and accepts it as an integral part of future businesses. Our journey started sixteen years ago and our passion for technology has created a positive impact. From what started as a small team, we have grown to a team of 350 employees globally.

A dozen years in business, never lost a client, 350+ technology professional on board, more than 100 client partnerships, do we have to say more?

Tentacle Technologies was founded in November 2001 with humble beginnings. Headquartered in Malaysia, today we operate in countries like Singapore, India and the Philippines. Our core services are Business Consulting, Software Development, Quality Assurance & IT solutions in Digital Transformation. We are techies with the right techniques to revamp businesses!

Unlike most of the tech companies that have been around since 2000’s, Tentacle Technologies understands the evolution of technology and accepts it as an integral part of future businesses. Our journey started sixteen years ago and our passion for technology has created a positive impact. From what started as a small team, we have grown to a team of 350 employees globally.

A dozen years in business, never lost a client, 350+ technology professional on board, more than 100 client partnerships, do we have to say more?

Tentacle Technologies was founded in November 2001 with humble beginnings. Headquartered in Malaysia, today we operate in countries like Singapore, India and the Philippines. Our core services are Business Consulting, Software Development, Quality Assurance & IT solutions in Digital Transformation. We are techies with the right techniques to revamp businesses!

Unlike most of the tech companies that have been around since 2000’s, Tentacle Technologies understands the evolution of technology and accepts it as an integral part of future businesses. Our journey started sixteen years ago and our passion for technology has created a positive impact. From what started as a small team, we have grown to a team of 350 employees globally.

A dozen years in business, never lost a client, 350+ technology professional on board, more than 100 client partnerships, do we have to say more?