Data Engineer (Junior / Senior)

Hytech Consulting Management Sdn Bhd; Kuala Lumpur; On-site; MYR 60,000 - 80,000; Full time

Job summary

A leading consulting firm in Malaysia is seeking a Data Engineer to oversee data ingestion and integration work. Responsibilities include designing data solutions, building reports, and ensuring data security. Ideal candidates should have strong SQL skills, proficiency in Python or R, and excellent communication abilities. Experience with cloud services and data visualization tools is a plus.

Qualifications

• Strong command of relational databases and SQL.
• Proficiency with Python or R for data manipulation and analysis.
• Demonstrated ability to learn new techniques and troubleshoot code independently.
• Excellent communication and interpersonal skills.
• Experience with cloud infrastructure services is preferred.

Responsibilities

• Oversee data ingestion and integration work.
• Design and maintain data engineering solutions and pipelines.
• Build reports and data visualizations.
• Implement security measures in data warehouse.
• Train data team staff.

Skills

Relational databases and SQL

Python

R

Data manipulation

Data visualization

APIs

Data Science

Education

BA or BS in related field or equivalent work experience

Tools

Gitlab

Amazon Web Services

PowerBI

Tableau

Job description

Add expected salary to your profile for insights

The Data Engineer will oversee the company’s data ingestion / integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data ingestion / integration and analysis. This role will work closely and collaboratively with members of the Data & Analytics and Development teams to define requirements, mine and analyze data, integrate data from a variety of sources, and deploy high quality data pipelines in support of the analytics needs. He will also be responsible for creating automated reporting / data visualization system based on the request of internal stakeholders.

Description of Duties

• Maintain and build on our data warehouse and analytics environment, the home for various source data generated in the company.
• Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse, and moving data out to applications.
• Build reports and data visualizations, using data from the data warehouse and other sources.
• Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
• Perform one-off data manipulation and analysis on a wide variety of source data.
• Implement and monitor best in class security measures in our data warehouse and analytics environment.
• Help other data team staff troubleshoot their SQL, Python, or R code.
• Train other data team staff on these skills.
• Other duties as assigned.

Qualifications

• Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database.
• Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools.
• BA or BS in related field or equivalent work experience.
• General data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets together, reformat data between wide and long, etc.
• Demonstrated ability to learn new techniques and troubleshoot code without support, ex. find answers to common programming challenges on Google. In other words, be able to learn on the job.
• Demonstrated ability to write clear code that is well-documented and stored in a version control system (we use Gitlab).
• Demonstrated ability to work independently and be a self-starter.
• Excellent listening, interpersonal, communication and problem-solving skills.
• Demonstrated ability to work effectively in teams, in both a lead and support role.
• Use APIs to push and pull data from various data systems and platforms.
• Experience working with cloud infrastructure services like Amazon Web Services is preferred.
• Effective time management skills, including demonstrated ability to manage and prioritize multiple tasks and projects.
• Experience with data visualization (PowerBI, Tableau) is helpful, but not required.
• Experience with Data Science is preferred, but not required.