Data Engineer (Junior / Senior)

Hytech Consulting Management Sdn Bhd; Kuala Lumpur; On-site; MYR 60,000 - 80,000; Full time

Job summary

A leading consulting firm in Kuala Lumpur is seeking a Data Engineer to oversee data ingestion and integration. The role involves developing a data model, maintaining a robust data warehouse, and collaborating closely with data and analytics teams. Responsibilities include designing data engineering solutions, producing data visualizations, and automating data management tasks. The ideal candidate will possess strong SQL skills and proficiency in Python or R, complemented by excellent problem-solving abilities and teamwork skills.

Qualifications

• Strong command of relational databases and SQL.
• Proficiency with Python or R for data manipulation and analysis.
• Demonstrated ability to troubleshoot code and learn new techniques.

Responsibilities

• Maintain and build the data warehouse and analytics environment.
• Design and implement scalable data engineering solutions.
• Build reports and data visualizations from various data sources.

Skills

SQL

Python

R

Data manipulation

API usage

Collaboration

Education

BA or BS in related field or equivalent work experience

Tools

Gitlab

Amazon Web Services

PowerBI

Tableau

Job description

The Data Engineer will oversee the company’s data ingestion / integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data ingestion / integration and analysis. This role will work closely and collaboratively with members of the Data & Analytics and Development teams to define requirements, mine and analyze data, integrate data from a variety of sources, and deploy high quality data pipelines in support of the analytics needs. He will also be responsible for creating automated reporting / data visualization system based on the request of internal stakeholders.

Responsibilities

• Maintain and build on our data warehouse and analytics environment, the home for various source data generated in the company.
• Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications.
• Build reports and data visualizations, using data from the data warehouse and other sources.
• Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
• Perform one-off data manipulation and analysis on a wide variety of source data.
• Implement and monitor best in class security measures in our data warehouse and analytics environment.
• Help other data team staff troubleshoot their SQL, Python, or R code.
• Train other data team staff on these skills.
• Other duties as assigned.

Qualifications

• Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database.
• Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools.
• BA or BS in related field or equivalent work experience.
• General data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets together, reformat data between wide and long, etc.
• Demonstrated ability to learn new techniques and troubleshoot code without support, e.g., find answers to common programming challenges on Google. In other words, be able to learn on the job.
• Demonstrated ability to write clear code that is well‑documented and stored in a version control system (we use Gitlab).
• Demonstrated ability to work independently and be a self‑starter.
• Excellent listening, interpersonal, communication and problem‑solving skills.
• Demonstrated ability to work effectively in teams, in both a lead and support role.
• Use APIs to push and pull data from various data systems and platforms.
• Experience working with cloud infrastructure services like Amazon Web Services is preferred.
• Effective time management skills, including demonstrated ability to manage and prioritize multiple tasks and projects.
• Experience with data visualization (PowerBI, Tableau) is helpful, but not required.
• Experience with Data Science is preferred, but not required.