Data Engineer

Techstreet Malaysia; Puchong; On-site; MYR 120,000 - 200,000; Full time

Job summary

Techstreet Malaysia is seeking an experienced Senior Data Engineer / Data Engineering Lead to join the Sales Planning function and spearhead data and analytics initiatives. This role combines hands‑on data engineering with technical project leadership, delivering end‑to‑end Azure pipelines and Power BI solutions while coordinating external vendors and collaborating with global teams.

The ideal candidate will assess requirements, define solutions, and manage delivery with stakeholders, remaining

Qualifications

• 5‑7+ years in Data Engineering or related field.
• Strong Azure, Databricks, Data Factory, and Data Lake experience.
• Proficient in SQL and Python.
• Proven Power BI report development experience.
• GitHub for source control and CI/CD concepts.
• Experience with Agile/Scrum and JIRA.

Responsibilities

• Lead end‑to‑end data engineering, data pipelines and Power BI initiatives.
• Design and maintain scalable Azure solutions (ADLS, Databricks, Data Factory).
• Develop and optimize data pipelines using SQL and Python.
• Work with Azure Data Lake Storage for storage and integration.
• Develop and enhance Power BI reports and dashboards.
• Coordinate vendors and guide data engineering delivery.
• Manage stakeholder expectations across business and tech teams.
• Support APIs and multi-source data integration.
• Apply Azure DevOps Pipelines or GitHub Actions and CI/CD concepts.
• Manage source code with GitHub and collaborate across teams.
• Operate in an Agile/Scrum environment using JIRA.

Skills

Data engineering

Leadership

Stakeholder management

Agile / Scrum

SQL

Python

Power BI

GitHub

JIRA

Tools

Azure

Azure Databricks

Azure Data Factory

Azure Data Lake Storage

Microsoft Entra ID / Azure AD

Azure Key Vault

Power BI

SQL

Python

GitHub

Azure DevOps

JIRA

Job description

Job Description

We are looking for an experienced Senior Data Engineer / Data Engineering Led to join the Sales Planning function and take a leading role in upcoming data and analytics initiatives.

This position combines hands‑on data engineering with technical project leadership. The successful candidate will lead the end‑to‑end delivery of Power BI solutions and Azure‑based data pipelines, while coordinate external vendors and work closely with business stakeholders and global teams.

The ideal candidate can independently assess technical requirements, define an appropriate solution approach, coordinate delivery, manage stakeholder expectations, and remain hands‑on where required.

Responsibilities

• Lead the end‑to‑end delivery of data engineering, data pipeline and Power BI initiatives.


• Design, develop and maintain scalable solutions using Microsoft Azure, Azure Data Factory and Azure Databricks.


• Develop, optimize and support data pipelines using SQL and Python.


• Work with Azure Data Lake Storage for data storage, processing and integration requirements.


• Develop and enhance Power BI reports and dashboards based on business needs.


• Coordinate external vendors and provide technical direction for data engineering activities.


• Manage communication and expectations across business stakeholders, technical teams and global counterparts.


• Support integration requirements involving APIs and multiple data sources.


• Apply Azure DevOps Pipelines and/or GitHub Actions, including pipeline triggers and CI/CD concepts.


• Manage source code and collaborative development using GitHub.


• Work within an Agile/Scrum environment and manage delivery through JIRA.


• Support secure Azure implementations using Microsoft Entra ID and Azure Key Vault.


• Provide technical guidance while remaining hands‑on with engineering and troubleshooting activities.

Requirements

• 5‑7+ years of experience in Data Engineering, Data Analytics, Data Platforms or a related technical environment.


• Strong hands‑on experience with Microsoft Azure, Azure Databricks, Azure Data Factory, Azure Data Lake Storage, Microsoft Entra ID / Azure Active Directory, and Azure Key Vault.


• Strong programming and data manipulation skills using SQL and Python.


• Proven experience in Power BI report development.


• Experience using GitHub for source control and collaborative development.


• Understanding of Azure DevOps Pipelines and/or GitHub Actions, including triggers and CI/CD concepts.


• General understanding and practical experience working with APIs.


• Experience working within Agile/Scrum environments and using JIRA.


• Proven ability to lead technical projects and coordinate delivery across multiple parties.


• Strong stakeholder management skills across business, technical, vendor and global teams.


• Ability to work independently within a flat structure and with minimal supervision.

Required Skills

• Python


• Cloud (AWS / Azure / GCP)


• Data Science / Machine Learning