Data Engineer - Lead/Principal

techstreet; Puchong; On-site; MYR 180,000 - 300,000; Full time

Job summary

techstreet is seeking an experienced Senior Data Engineer to lead the Sales Planning data initiatives. You will drive end-to-end data engineering, Azure-based pipelines, and Power BI solutions while coordinating with external vendors and global teams.

The role requires hands-on coding with Python/SQL, strong stakeholder management, and proven delivery of data platforms in an Agile environment. You will work closely with business stakeholders and cross-functional teams to ensure scalable, secure

Qualifications

• 5-7+ years of data engineering/analytics experience.
• Strong Python and SQL programming skills.
• Experience with Azure data services and BI reporting.

Responsibilities

• Lead end-to-end data engineering, data pipeline and Power BI initiatives.
• Design, develop and maintain scalable solutions using Microsoft Azure services.
• Develop, optimize and support data pipelines using SQL and Python.

Skills

Python

SQL

Stakeholder management

Agile/Scrum

Tools

Azure Data Factory

Azure Databricks

Azure Data Lake Storage

Power BI

GitHub

Azure DevOps Pipelines

JIRA

Job description

We are looking for an experienced Senior Data Engineer / Data Engineering Led to join the Sales Planning function and take a leading role in upcoming data and analytics initiatives.

This position combines hands-on data engineering with technical project leadership. The successful candidate will lead the end-to-end delivery of Power BI solutions and Azure-based data pipelines, while coordinate external vendors and work closely with business stakeholders and global teams.

The ideal candidate can independently assess technical requirements, define an appropriate solution approach, coordinate delivery, manage stakeholder expectations, and remain hands-on where required.

Key responsibilities

• Lead the end-to-end delivery of data engineering, data pipeline and Power BI initiatives.
• Design, develop and maintain scalable solutions using Microsoft Azure, Azure Data Factory and Azure Databricks.
• Develop, optimize and support data pipelines using SQL and Python.
• Work with Azure Data Lake Storage for data storage, processing and integration requirements.
• Develop and enhance Power BI reports and dashboards based on business needs.
• Coordinate external vendors and provide technical direction for data engineering activities.
• Manage communication and expectations across business stakeholders, technical teams and global counterparts.
• Support integration requirements involving APIs and multiple data sources.
• Apply Azure DevOps Pipelines and/or GitHub Actions, including pipeline triggers and CI/CD concepts.
• Manage source code and collaborative development using GitHub.
• Work within an Agile/Scrum environment and manage delivery through JIRA.
• Support secure Azure implementations using Microsoft Entra ID and Azure Key Vault.
• Provide technical guidance while remaining hands-on with engineering and troubleshooting activities.

About you

• 5-7+ years of experience in Data Engineering, Data Analytics, Data Platforms or a related technical environment.
• Strong programming and data manipulation skills using SQL and Python.
• Experience using GitHub for source control and collaborative development.
• Understanding of Azure DevOps Pipelines and/or GitHub Actions, including triggers and CI/CD concepts.
• General understanding and practical experience working with APIs.
• Experience working within Agile/Scrum environments and using JIRA.
• Proven ability to lead technical projects and coordinate delivery across multiple parties.
• Strong stakeholder management skills across business, technical, vendor and global teams.
• Ability to work independently within a flat structure and with minimal supervision.

Required Skills

• Python
• Data Science / Machine Learning