Data Engineer

Techstreet Malaysia; Puchong; Presencial; MYR 180 000 - 260 000; Tempo integral

Resumo da oferta

Techstreet Malaysia is seeking an experienced Senior Data Engineer to lead the Sales Planning data initiatives. You will own end-to-end data engineering, Azure pipelines (ADF/Databricks) and Power BI insights, while coordinating external vendors and collaborating with business stakeholders and global teams.

The ideal candidate will work hands-on when required, assess requirements, define solutions, and manage delivery in an Agile environment, with strong SQL/Python skills and API experience.

Qualificações

• 5-7+ years of experience in Data Engineering, Data Analytics, Data Platforms or related technical environment.
• Strong programming and data manipulation skills using SQL and Python.
• Experience using GitHub for source control and collaborative development.
• Understanding of Azure DevOps Pipelines and/or GitHub Actions, including triggers and CI/CD concepts.
• General understanding and practical experience working with APIs.
• Experience working within Agile/Scrum environments and using JIRA.
• Proven ability to lead technical projects and coordinate delivery across multiple parties.
• Strong stakeholder management skills across business, technical, vendor and global teams.
• Ability to work independently within a flat structure and with minimal supervision.

Responsabilidades

• Lead the end-to-end delivery of data engineering, data pipeline and Power BI initiatives.
• Design, develop and maintain scalable solutions using Microsoft Azure, Azure Data Factory and Azure Databricks.
• Develop, optimize and support data pipelines using SQL and Python.
• Work with Azure Data Lake Storage for data storage, processing and integration requirements.
• Develop and enhance Power BI reports and dashboards based on business needs.
• Coordinate external vendors and provide technical direction for data engineering activities.
• Manage communication and expectations across business stakeholders, technical teams and global counterparts.
• Support integration requirements involving APIs and multiple data sources.
• Apply Azure DevOps Pipelines and/or GitHub Actions, including pipeline triggers and CI/CD concepts.
• Manage source code and collaborative development using GitHub.
• Work within an Agile/Scrum environment and manage delivery through JIRA.
• Support secure Azure implementations using Microsoft Entra ID and Azure Key Vault.
• Provide technical guidance while remaining hands-on with engineering and troubleshooting activities.

Conhecimentos

SQL

Python

GitHub

Azure DevOps Pipelines

GitHub Actions

JIRA

APIs

Agile/Scrum

Stakeholder management

Leadership

Ferramentas

Power BI

Azure Data Factory

Azure Databricks

Azure Data Lake Storage

Descrição da oferta de emprego

We are looking for an experienced Senior Data Engineer / Data Engineering Led to join the Sales Planning function and take a leading role in upcoming data and analytics initiatives.

This position combines hands-on data engineering with technical project leadership. The successful candidate will lead the end-to-end delivery of Power BI solutions and Azure-based data pipelines, while coordinate external vendors and work closely with business stakeholders and global teams.

The ideal candidate can independently assess technical requirements, define an appropriate solution approach, coordinate delivery, manage stakeholder expectations, and remain hands-on where required.

Responsibilities

• Lead the end-to-end delivery of data engineering, data pipeline and Power BI initiatives.
• Design, develop and maintain scalable solutions using Microsoft Azure, Azure Data Factory and Azure Databricks.
• Develop, optimize and support data pipelines using SQL and Python.
• Work with Azure Data Lake Storage for data storage, processing and integration requirements.
• Develop and enhance Power BI reports and dashboards based on business needs.
• Coordinate external vendors and provide technical direction for data engineering activities.
• Manage communication and expectations across business stakeholders, technical teams and global counterparts.
• Support integration requirements involving APIs and multiple data sources.
• Apply Azure DevOps Pipelines and/or GitHub Actions, including pipeline triggers and CI/CD concepts.
• Manage source code and collaborative development using GitHub.
• Work within an Agile/Scrum environment and manage delivery through JIRA.
• Support secure Azure implementations using Microsoft Entra ID and Azure Key Vault.
• Provide technical guidance while remaining hands-on with engineering and troubleshooting activities.

Requirements

• 5-7+ years of experience in Data Engineering, Data Analytics, Data Platforms or a related technical environment.
• Strong programming and data manipulation skills using SQL and Python.
• Experience using GitHub for source control and collaborative development.
• Understanding of Azure DevOps Pipelines and/or GitHub Actions, including triggers and CI/CD concepts.
• General understanding and practical experience working with APIs.
• Experience working within Agile/Scrum environments and using JIRA.
• Proven ability to lead technical projects and coordinate delivery across multiple parties.
• Strong stakeholder management skills across business, technical, vendor and global teams.
• Ability to work independently within a flat structure and with minimal supervision.