Data Engineer

Infosys; Selangor; On-site; MYR 80,000 - 120,000; Full time

Job summary

A leading technology services firm in Malaysia is seeking a Data Engineer to build and maintain data ingestion pipelines in Databricks. The ideal candidate should have strong skills in ETL tools and cloud computing, with 5-7 years of experience in big data technologies. This role emphasizes teamwork and collaboration with BI and data governance teams to ensure data accuracy and quality.

Qualifications

• 5-7 years in data processing, cloud computing, and big data technologies.
• Strong expertise in Azure Databricks and ETL/ELT tools.
• Experience with DBT, Coalesce or similar tools is an advantage.

Responsibilities

• Build, test, and maintain data pipelines in Databricks.
• Implement business logic and transformations using ETL tools.
• Collaborate with BI and data governance teams.

Skills

Data processing

Cloud computing

Azure Databricks

ETL/ELT tools

SQL

CI/CD

Data quality frameworks

Collaboration

Tools

DBT

Coalesce

Azure Data Factory

Boomi Integration Platform

Job description

Responsibilities

Build, test, and maintain ingestion and transformation pipelines in Databricks.

Implement business logic and transformations using DBT or Coalesce.

Handle data wrangling, cleansing, and CDC-based incremental loads.

Ensure scalability, maintainability, and quality of pipelines.

Conduct unit and integration testing for transformations.

Collaborate with BI and data governance teams to ensure consistent data structures.

Implement the architectural designs and ensure data accuracy.

Required Skills & Experience

5-7 years in data processing, cloud computing, data platform and other big data technologies - preferably in mining or heavy industries.

Strong expertise and experience in Azure Databricks and other ETL/ELT tools, SQL, CI/CD and data quality frameworks.

Experience or exposure to transformation tool like DBT or Coalesce or Azure Data Factory or Boomi Integration Platform is an advantage, but not mandatory.

Excellent technical design and build documentation.

Strong team player.