Data Engineer

NEXTDC; Selangor; On-site; MYR 100,000 - 150,000; Full time

Job summary

A leading data services company in Malaysia is seeking a Data Engineer responsible for designing, building, and maintaining robust data pipelines within the Azure ecosystem. The role requires collaboration with stakeholders to ensure data accuracy and consistency, while implementing best practices for data management. The ideal candidate will leverage Azure technologies to enhance data quality and support organizational needs. This position offers the chance to progress within a diverse and inclusive company culture.

Benefits

Opportunity for career growth

Inclusive and diverse culture

Participation in innovative projects

Qualifications

• Experience designing, building, and maintaining data pipelines in Azure.
• Ability to ensure data accuracy, consistency, and reliability.
• Strong collaboration skills to work with various stakeholders.

Responsibilities

• Design, build, and maintain ETL pipelines using Azure Fabric.
• Ensure data quality within data marts through validation processes.
• Develop and optimize data mart structures for efficient retrieval.
• Optimize data processing to improve performance and reduce costs.
• Collaborate with analysts and developers to meet data needs.
• Document data pipelines and related processes comprehensively.
• Ensure compliance with security policies and data protection standards.

Skills

ETL development

Data quality management

Database design

Performance tuning

Collaboration

Documentation

Security and compliance

Tools

Azure Fabric

Azure SQL Database

Azure Data Factory

Azure Databricks

Job description

Company Description

At NEXTDC we are building the heart of Australia & Asia’s high-tech future. We design, build and operate world class, next generation data centres, using cutting edge, environmentally efficient infrastructure to service the specific requirements of local, international hyperscale customers.

We are expanding our presence globally, including a new data centre in PJ, meeting the current and future digital needs of Malaysia by accelerating job skills, direct investment and economic prosperity.

At NEXTDC, we know that our success depends on the talents of our people, and we foster a culture of continued learning and development. Our culture is built on collaboration and innovation, we are passionate about what we do, and we are committed to our mission to be the leading customer-centric data centre services company.

Job Description

At NEXTDC we are building the heart of Australia & Asia’s high-tech future. We design, build and operate world class, next generation data centres, using cutting edge, environmentally efficient infrastructure to service the specific requirements of local, international hyperscale customers.

We are expanding our presence globally, including a new data centre in PJ, meeting the current and future digital needs of Malaysia by accelerating job skills, direct investment and economic prosperity.

At NEXTDC, we know that our success depends on the talents of our people, and we foster a culture of continued learning and development. Our culture is built on collaboration and innovation, we are passionate about what we do, and we are committed to our mission to be the leading customer-centric data centre services company.

Qualifications

As our Data Engineer you’ll be responsible for designing, building, and maintaining robust data pipelines and data marts within the Azure ecosystem. This role ensures the accuracy, consistency, and accessibility of data, enabling the organisation to make data-driven decisions. Here you’ll collaborate with various stakeholders to understand data requirements, optimise data processing, and implement best practices for data management. This position is crucial for leveraging Azure technologies to enhance data quality and support the organisation's analytical and operational needs.

Within this position, your scope will cover:

• Data Pipeline Development: Design, build, and maintain ETL (Extract, Transform, Load) pipelines to move data from various sources to data marts using Azure Fabric
• Data Quality Management: Ensure the accuracy, consistency, and reliability of data within the data marts, implementing data validation and cleansing processes
• Database Design: Develop and optimize the structure of data marts to support efficient data retrieval and analysis, leveraging Azure SQL Database and other Azure data services
• Performance Tuning: Optimize data processing and storage to improve performance and reduce costs, utilizing Azure Data Factory, Azure Databricks, and other relevant tools
• Collaboration: Work closely with data analysts, BI developers, and other stakeholders to understand data requirements and deliver solutions that meet business needs
• Documentation: Maintain comprehensive documentation of data pipelines, data marts, and related processes to support knowledge sharing and continuity
• Security and Compliance: Ensure that data solutions adhere to security policies and compliance standards, implementing best practices for data protection and access control

Additional Information

• Opportunity to be a vital part of NEXTDC and the expanding Data Centre world
• Inclusive, diverse and values-driven working culture
• Great opportunities to progress within our company (grow as we grow)

Our mission is to continue building a diverse and inclusive workforce which represents the communities in which we operate.

Make NEXTDC your next move.