Data Engineer

Michael Page; Kuala Selangor; On-site; MYR 80,000 - 100,000; Full time

Job summary

A leading automotive group in Kuala Selangor is seeking a Data Engineer to design, implement, and manage complex data engineering solutions. The ideal candidate has over 3 years of experience with Azure Data Platform and is skilled in developing CI/CD pipelines using Azure DevOps. This role offers a competitive salary, medical benefits, and a flexible working environment while working on large-scale projects.

Benefits

Medical Benefits

Flexible working environment

Free Lunch during WFO days

Qualifications

• At least 3 years of experience in data engineering solutions using Azure Data Platform.
• Proficient in building and maintaining scalable data pipelines and CI/CD workflows.
• Strong analytical skills to translate business requirements into data solutions.

Responsibilities

• Design and maintain data engineering solutions and pipelines using Azure tools.
• Develop CI/CD pipelines for automated build and deployment processes.
• Monitor pipeline performance and implement optimizations.

Skills

Data engineering solutions management

CI/CD pipelines with Azure DevOps

SQL scripting

Data visualization with Power BI or Qlik Sense

Data quality monitoring

Tools

Azure Data Factory

Azure Synapse Analytics

Azure Data Lake

Azure SQL

Job description

• Opportunity to be involved in exciting projects
• Competitive salary

About Our Client

This company is a leading automotive group operating across the Asia-Pacific region, involved in vehicle distribution, retail, after-sales services, and car rental. It assembles vehicles for international brands, represents a wide portfolio from luxury to commercial marques, and is actively expanding into electric vehicles and digital transformation initiatives.

Job Description

• Design, implement, and maintain complex data engineering solutions and data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Data Lake to acquire, prepare, and integrate data across multiple sources and systems.
• Develop and manage continuous integration and deployment (CI/CD) pipelines with Azure DevOps to automate the build, testing, and deployment of data workflows, ensuring robust and scalable delivery processes.
• Monitor and optimize pipeline performance and scalability by analyzing system metrics and implementing improvements to handle large data volumes efficiently.
• Perform complex data quality validation and remediation, leading data migration and data conversion activities to ensure data integrity and compliance with organizational data governance standards.
• Administer and optimize databases such as Azure SQL by automating routine tasks with scripts and tools, monitoring performance metrics, investigating operational issues, and implementing maintenance updates.
• Apply standard data management practices, monitor ongoing data quality through reviews and validation checks, and communicate procedures to ensure team-wide compliance.
• Design and create data visualizations using Power BI and Qlik Sense, working closely with users to prototype and refine dashboards and reports; assist in machine learning tasks by preparing data, training models using Azure AI and ML tools, deploying models into production, and monitoring their performance.

The Successful Applicant

• Has at least 3 years of hands-on experience operating and managing data engineering solutions using Azure Data Platform components such as Synapse Analytics, Data Factory, Data Lake, and Azure SQL.
• Proficient in designing, building, and maintaining scalable data pipelines and CI/CD workflows using Azure DevOps and automation scripting to ensure efficient data integration and deployment.
• Skilled in SQL scripting and data modeling with strong analytical and numerical abilities to translate business requirements into effective data solutions and reports.
• Experienced in applying data management best practices, conducting data quality monitoring, and implementing remediation processes to maintain data accuracy and governance compliance.
• Familiar with data visualization tools like Power BI or Qlik Sense, able to create insightful dashboards and reports that support data-driven decision-making.
• Knowledgeable in Azure AI and Machine Learning frameworks, capable of assisting in model training, evaluation, deployment, and monitoring to solve business problems using advanced analyt

What’s on Offer

• Contract: 1 year
• Medical Benefits
• Flexible working environment
• Free Lunch during WFO days
• Opportunity to work on large scale projects