Data Engineer

Raizon Consulting Sdn. Bhd; Malaysia; On-site; MYR 70,000 - 90,000; Full time

Job summary

A consulting firm in Malaysia is seeking a highly motivated Data Engineer to design, build, and maintain data infrastructure. Ideal candidates will have a Bachelor’s degree and 3-5 years of experience in data engineering, with proficiency in SQL, NoSQL, and programming languages like Python or Java. Fresh graduates are encouraged to apply for this critical role in optimizing data management systems.

Qualifications

• Minimum of 3–5 years of experience in data engineering or related roles.
• Experience with managing databases and building scalable data architectures.
• Fresh graduates are encouraged to apply.

Responsibilities

• Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
• Design and implement efficient, scalable ETL processes.
• Ensure data quality and integrity through data governance frameworks.
• Collaborate with data scientists and analysts to understand data needs.
• Optimize and tune data systems for end-user functionality.
• Develop monitoring processes for data systems' performance.
• Maintain clear documentation of all data processes.

Skills

SQL

NoSQL databases

Python

Java

Scala

Hadoop

Spark

Kafka

AWS

Azure

Google Cloud

Redshift

Snowflake

BigQuery

Apache Airflow

Education

Bachelor’s degree in Computer Science, Information Technology, or a related field

Job description

We are looking for highly motivated and savvy Data Engineers to grow capabilities and expand our Consulting practice in Malaysia and APAC. Candidates who aspire to be data professionals and have attained a Graduate degree in Computer Science, Information Technology, or other related field should apply to join our growing team of experts.

Data Engineer duties revolve around designing, building, and maintaining the infrastructure that allows businesses to manage and analyse large datasets effectively. This role is pivotal in transforming raw data into valuable information, facilitating data-driven decision-making, and ensuring the seamless operation of data management systems within the organization.

RESPONSIBILITIES

1. Design and Maintenance of Data Pipelines: Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
2. ETL Development: Design and implement efficient, scalable ETL processes to improve data accessibility and usability.
3. Data Management: Ensure data quality and integrity by implementing proper data governance frameworks.
4. Collaboration: Partner with data scientists, analysts, and other stakeholders to understand data needs and deliver solutions.
5. Performance Tuning: Optimize and tune data systems for greater functionality in support of end-user needs.
6. Monitoring and Troubleshooting: Develop monitoring processes to track the performance and availability of data systems, responding to incidents and troubleshooting issues.
7. Documentation: Maintain clear and detailed documentation of all data processes and systems.

TECHNICAL SKILL SET

• Extensive experience with SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB).
• Proficiency in programming languages such as Python, Java, or Scala.
• Familiarity with big data technologies like Hadoop, Spark, and Kafka.
• Experience with cloud computing services, particularly AWS, Azure, or Google Cloud.
• Knowledge of data warehousing solutions such as Redshift, Snowflake, or BigQuery.
• Experience with workflow management tools such as Apache Airflow or similar.
• Knowledge in data architecture and data modelling.

SOFT SKILL SET

• Problem-Solving: Strong analytical skills to solve complex problems and drive data-driven decisions.
• Communication: Excellent communication skills to articulate complex data concepts to a variety of stakeholders.
• Collaboration: Proven ability to work well in a team-oriented environment with cross-functional teams.
• Attention to Detail: Keen attention to detail in data analysis and troubleshooting.
• Time Management: Ability to manage multiple priorities and projects in a fast-paced environment.

WORK EXPERIENCE

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Minimum of 3–5 years of experience in data engineering or related roles.
• Experience with managing databases and building scalable data architectures.
• Fresh graduates are encouraged to apply.