Data Engineer

DPE Global Services Centre (Malaysia); Petaling Jaya; On-site; MYR 90,000 - 130,000; Full time

Job summary

DPE Global Services Centre (Malaysia) is seeking a Data Engineer to collaborate with business stakeholders to solve data accessibility challenges and promote data-driven decision making. You will create and manage data pipelines aligned to standards and best practices.

The role requires hands-on experience with T-SQL, data pipelines, data modelling, Power BI, Snowflake, Azure Data Factory, and GDPR compliance.

Qualifications

• At least 4+ years’ experience with T-SQL.
• Experience creating data pipelines including inbound/outbound feeds and data transformation.
• Strong data modelling including Data Warehouse modelling.
• Power BI modelling experience.
• Excellent communication and time management skills.
• Ability to self-learn new technologies.
• Experience with GDPR awareness and compliance.
• Snowflake Cloud Data Warehouse experience.
• Azure Data Factory experience.
• Experience or understanding of GDPR.
• SSRS, SSIS and SSAS experience.

Responsibilities

• Work with Data Engineering Team Lead to provide solutions addressing project requirements; adhere to data standards.
• Ensure production processes and pipelines function correctly and scale.
• Understand data compliance requirements and ensure pipelines/models comply.
• Create and maintain documentation as required.
• Coordinate with Operations for release detail and change control.
• Support the team (Dev and Ops) when required.
• Log timesheets against project work.

Skills

Communication skills

Time management

Organisational skills

Problem solving

Self-learning

Emerging technologies

GDPR awareness

Tools

T-SQL

Azure Data Factory

Snowflake

Power BI

SSIS

SSRS

SSAS

Job description

Objective:

This role is responsible for working with the Business stakeholders to solve their data accessibility challenges and promoting the use of data throughout DPE to enable data driven decision making. Creating and managing the data pipelines that are accurate, efficient, aligned to Data standards and best practices for data engineering.

Responsibilities:

• Work with the Data Engineering Team Lead to provide solutions that address project requirements. Ensure development work adheres to Data standards and best practices.
• Ensure production processes, data feeds, pipelines function correctly as required by the business. Ensure system performance and capacity are managed appropriately.
• Understand Data Compliance requirements and ensure data pipelines and models are adhering to the requirements.
• Create and maintain documentation as required.
• Work with the Operations team to ensure appropriate level of detail is provided for releases and adhere to change control processes.
• Support the team (Dev and Ops) when required.
• Appropriate time sheet logging against project work

Requirements:

• At least 4+ years’ experience with T-SQL.
• Strong experience in creating data pipelines including inbound/outbound feeds and data transformation.
• Strong data modelling including Data Warehouse modelling
• Power BI & modelling.
• Good communication skills Good time management and organisational skills Strong attention to detail Ability to problem solve complex processes.
• Experience or exposure with cloud-based data environments Ability to self-learn new technology.
• Passionate about new and emerging technologies
• Snowflake Cloud Datawarehouse experience
• Azure Data factory experience
• Experience or proven understanding of GDPR
• SSRS, SSIS and SSAS