Data Engineer

Y-Axis; Kuala Lumpur; Hybrid; MYR 120,000 - 180,000; Full time

Job summary

Y-Axis in Kuala Lumpur, Malaysia is seeking a skilled ETL/Data Engineer to develop and maintain ETL processes, design data pipelines, and ensure high data quality for BI and reporting. You will connect to APIs and various data sources, transform data into reliable datasets, and document designs and flows.

The role involves translating business requirements into efficient ETL solutions, participating in design and prototyping, and collaborating with DevOps on deployments and cloud migration.

Qualifications

• Proven experience building and maintaining ETL workflows.
• Experience designing data pipelines to support BI and reporting.
• Ability to translate business requirements into data models and ETL solutions.
• Strong documentation skills for designs and data flows.
• Familiarity with Azure, SQL Server, and Visual Studio.

Responsibilities

• Develop and maintain ETL processes and data pipelines.
• Design, develop, and optimize data pipelines to support BI and reporting.
• Connect to diverse data sources, cleanse and transform data into business-ready datasets.
• Analyze requirements and translate into data models and ETL solutions.
• Produce technical documentation for designs, data flows and projects.
• Participate in requirements gathering, solution design, prototyping and implementation.
• Monitor, troubleshoot, and optimize ETL workflows for performance and data quality.
• Support DevOps by automating deployments and cloud migration efforts.
• Develop end-to-end business solutions using .NET, C#, Visual Studio, and SQL Server.

Skills

ETL processes

Data pipelines

BI & reporting

Data modeling

Requirements gathering

Solution prototyping

DevOps

Cloud migration

Data quality

Tools

Azure

SQL Server

SQL Data Warehouse

Visual Studio

API integrations

Job description

• Develop and maintain ETL processes to extract, transform, and load data from various sources, including APIs and other programmatic integrations.
• Design, develop, and optimize data pipelines to support business intelligence and reporting initiatives.
• Connect to diverse data sources, import, cleanse, and transform data into reliable, business-ready datasets.
• Analyze business requirements and translate them into efficient data models and ETL solutions.
• Produce clear technical documentation, including solution designs, data flows, and project documentation.
• Participate in requirements gathering, solution design, prototyping, and implementation activities.
• Work with Microsoft technologies such as Azure, SQL Server, SQL Data Warehouse, and Visual Studio to build and support data solutions.
• Support DevOps initiatives by automating deployment processes and contributing to cloud migration efforts.
• Develop end-to-end business solutions using .NET, C#, Visual Studio, and Microsoft SQL Server.
• Monitor, troubleshoot, and optimize ETL workflows to ensure performance, reliability, and data quality.