Data Engineer — Azure, Databricks & PowerBI

Ekco; Kuala Lumpur; On-site; MYR 120,000 - 180,000; Full time

Benefits offered by this job

Time Off: 15 days + holidays

Birthday Leave

Company Pension Scheme

EAP for wellbeing

EkcOlympics

Pluralsight access

International progression

Job summary

Ekco is seeking true Full Stack Data Engineers who own the entire data value chain. You will collect, process, and visualize data, while engaging business stakeholders to gather requirements and validate data accuracy.

The PowerBI Embedded architecture is in place; you will build pipelines and reports feeding it. You will develop robust Azure Functions in Python to pull data from multiple APIs, craft PySpark transformations in Databricks, and deliver insightful BI dashboards with a star-schema

Qualifications

• 3-5+ years of experience as a Data Engineer or BI Developer.
• Strong English communication to discuss requirements with non-technical colleagues.
• Proficient in Python and REST APIs.
• Experience with PySpark transformations and Databricks.
• Deep knowledge of PowerBI data modeling (star schema) and DAX.
• Ability to translate one-line requirements into finished reports autonomously.

Responsibilities

• Requirements & Validation: talk to business stakeholders to understand insights; translate needs into tasks; demonstrate PowerBI results to validate numbers.
• Data Collection: build and maintain Azure Functions (Python) to fetch data from various APIs; handle authentication, pagination, errors.
• Data Engineering: develop PySpark notebooks in Databricks to transform raw JSON into structured data (Bronze/Silver/Gold).
• Reporting: build PowerBI models and dashboards with efficient data models.
• Maintenance: monitor pipelines and fix issues proactively.

Skills

Data Engineer

BI Developer

Python

APIs

Databricks

SQL

PowerBI

Autonomy

English communication

Tools

Databricks

PowerBI

REST APIs

Job description

Ekco is seeking true Full Stack Data Engineers who own the entire data value chain. You will collect, process, and visualize data, while engaging business stakeholders to gather requirements and validate data accuracy.

The PowerBI Embedded architecture is in place; you will build pipelines and reports feeding it. You will develop robust Azure Functions in Python to pull data from multiple APIs, craft PySpark transformations in Databricks, and deliver insightful BI dashboards with a star-schema