Data Engineer

Second Talent; Kuala Lumpur; Hybrid; MYR 100,000 - 140,000; Full time

Job summary

A leading data solutions company is looking for a Data Engineer in Kuala Lumpur to enhance their data analytics capabilities. The ideal candidate should have a degree in Computer Science and at least three years of experience in data engineering, particularly with Azure Databricks or Synapse. The role offers a flexible work schedule, work from home options, and various benefits including medical insurance and performance bonuses.

Benefits

Work from home (2 days)

Flexible working shifts

Performance bonus

Medical/dental/life insurance

14-20 days annual leave

Qualifications

• At least three years of experience in data engineering.
• Hands on experience in Azure Databricks or Synapse.
• Experience in designing and deploying data applications on cloud solutions.

Responsibilities

• Plan, implement and maintain the company's data platform and solutions.
• Design, build and automate modern data pipelines and data streams.
• Ensure data quality and accuracy by performing data profiling, data cleansing, and data validation.

Skills

SQL proficiency

Problem-solving skills

Data-driven thinking

Programming languages (PySpark, Python, R, Java, Scala)

Azure Databricks or Synapse

Good written and spoken English

Education

Degree in Computer Science, Information Technology, or relevant disciplines

Tools

Azure

Job description

If you get excited about a work/life balance, enjoy working with data and collaborate with people who are creative, motivated, and fun JOIN US! We are building a new global data engineering team to support the companys various digital initiatives and data projects. This position plays a crucial role in developing the companys data analytics capabilities.

We offer work from home (2 days), flexible working shifts (8:00am-4:30pm, 9:00am-5:30pm, 10:00am-6:30pm), 14-20 days annual leave, double pay, performance bonus, overtime pay, medical/dental/life insurance, five-day work week.

Job Description

• Plan, implement and maintain the companys data platform and solutions.
• Design, build and automate modern data pipelines and data streams.
• Develop and maintain data models and schemas that facilitate data integration and analysis.
• Implement effective metrics, monitor, and proactively optimize ETL/ELT process performances, troubleshoot issues, and implement improvements to enhance data process efficiency in the data lifecycle.
• Collaborate with data analysts, data stewards and business stakeholders to understand their data requirements and translate them into technical specifications.
• Ensure data quality and accuracy by performing data profiling, data cleansing, and data validation.
• Evaluate the performance and applicability of data tools against user requirements.
• Perform related duties as assigned, within the scope of practice (e.g., data quality and data education programs).

Requirements

• Degree holder in Computer Science, Information Technology, or relevant disciplines.
• At least three years of experience in data engineering.
• Proficiency level of SQL is a must.
• Hands on experience in Azure Databricks or Synapse.
• Hands on experience in programming languages for data engineering (e.g., PySpark, Python, R, Java, Scala).
• Experience in designing and deploying data applications on cloud solutions, such as Azure.
• Possess excellent problem-solving skills and data-driven thinking capabilities.
• Ability to work independently and as a member of a team, self-motivated.
• Good communication in both written and spoken English.
• Willingness to travel, as needed.

The requirements below are considered as advantages, but not required.

• Hands on experience in performance tuning and optimizing code running in Azure Databricks or Synapse environment.
• Experience in preparing data for data science and machine learning.