Pentaho Data Integration (PDI) Developer

Reliable Business Technologies Sdn Bhd; Kuala Lumpur; On-site; MYR 90,000 - 120,000; Full time

Job summary

Reliable Business Technologies Sdn Bhd is seeking a Pentaho Data Integration (PDI) Developer to design, build and deploy end-to-end ETL pipelines across data warehouses and data lakes. The role requires 3–5 years hands-on experience with multiple source systems including Oracle, SQL Server, PostgreSQL, MySQL and APIs.

You will optimize transformations, ensure data quality and collaborate with BI teams. We value strong SQL skills, experience with AWS/S3 data lake formats, and capabilities in SCD

Qualifications

• 3–5 years hands-on experience in designing, developing and deploying end-to-end ETL pipelines.
• Experience with diverse source systems including Oracle, SQL Server, PostgreSQL, MySQL, APIs and cloud sources.
• Proficiency in building scalable ETL workflows and data integration for data warehouses/lakes.
• Strong SQL skills and knowledge of data quality checks, error handling and logging.

Responsibilities

• Collaborate with business users, BI teams and data architects to translate requirements into ETL specs.
• Design and develop PDI transformations and jobs to ingest, cleanse and integrate data into the Data Warehouse.
• Implement business rules, data quality checks, and exception handling in ETL workflows.
• Develop dimensional models (facts, dimensions, surrogate keys, SCD logic) for reporting.
• Optimize ETL workflows for performance, scalability and reliability; manage scheduling and monitoring.

Skills

PDI/Kettle

ETL design

SQL & DBs

Data quality checks

Dimensional modeling

Performance tuning

Education

Bachelor's or Master's in Computer Science / IS / Data Science

Tools

Pentaho Data Integration (PDI)

Kitchen/Pan

Cloud data sources

Job description

Pentaho Data Integration (PDI) Developer

A results-driven Pentaho Data Integration (PDI/Kettle) Developer or any other ETL tool with over 3-5 years of hands-on experience in designing, developing, and deploying end to end ETL pipelines across Data Warehouses and Data Lake environments. Highly proficient in integrating data from diverse source systems such as Oracle, SQL Server, PostgreSQL, MySQL, APIs, and cloud-based sources. Skilled in building scalable ETL workflows, implementing data quality checks, designing dimensional models, and optimizing transformation performance for enterprise data platforms.

Key responsibilities

Collaborate with business users, BI teams, and data architects to understand reporting and analytical requirements and translate them into ETL specifications.

Design and develop PDI transformations and jobs to ingest, cleanse, validate, and integrate data from multiple source systems into the enterprise Data Warehouse.

Implement business rules, data quality checks, error handling, and exception management within ETL PDI workflows.

Develop and maintain dimensional models (fact tables, dimensions, surrogate keys, SCD logic) to support reporting and dashboards.

Optimize existing ETL workflows for performance, scalability, reliability, and proper resource utilization.

Manage scheduling, monitoring, and alerting for daily, weekly, and monthly ETL jobs using Kitchen/Pan and OS schedulers.

Troubleshoot job failures, conduct root cause analysis, and provide permanent fixes to ensure uninterrupted data operations.

Work with DBAs, cloud teams, and infrastructure engineers for performance tuning, environment setup, data modeling, and query optimization.

Maintain technical documentation including mapping sheets, ETL logic, SDS/SRS-style specifications, runbooks, and deployment guides.

Support UAT cycles, production releases, and post-deployment validation to ensure high-quality deliverables.

About you

3-5 years of hands-on experience in designing, developing, and deploying end to end ETL pipelines

Highly proficient in Pentaho Data Integration (PDI/Kettle): Transformation design, job orchestration, workflow branching, parameterization, repository migration, error handling & logging.

Experience extracting data from RDBMS, flat files, APIs, cloud sources, and loading into DWH/Data Lake environments.

Strong SQL experience with Oracle, SQL Server, PostgreSQL, MySQL, Vertica.

Exposure to AWS, S3/Data Lake storage, Parquet outputs, and distributed data processing.

Experience with data profiling, validations, cleansing transformations, SCD Type 1 & 2 logic, audit & reconciliation frameworks.

Expertise in tuning transformations, SQL optimization, lookup caching, memory management, and parallel execution.

Bachelor's or master's degree in computer science, Information Systems, Data Science, or a related field.

We are a well established TUV Star 3* rated software house. At Reliable we build innovations that drive our client’s business. We take up challenging transformation, digitalisation and cloud technology projects for our clients and build scalable software and systems.

Reliable Business Technologies Sdn Bhd delivers cutting edge Enterprise IT solutions in niche areas like Telecommunications/Finance/Government sectors using innovative technology for clients in Malaysia and Overseas.

Our motto is \"Towards Technology Excellence\"

This along with core human values of integrity, honesty and our go getting attitude is the recipe of our success. If you are excited about working in challenging IT environment, we invite you to grow together with us.

Our Website: http://www.rbtsb.com/

Contact: 03 - 2283 1353