Data Engineer

HURELAX PTE. LTD.; Singapore; On-site; SGD 70,000 - 90,000; Full time

Job summary

A leading tech company in Singapore is looking for a Data Engineer to handle ETL tasks and data warehouse management. Candidates should have over 4 years of database experience and familiarity with frameworks like Hadoop and Spark. Proficiency in Java, Scala, or Python, along with SQL skills, is required. This role emphasizes detail orientation and communication within a team.

Qualifications

• Over 4 years of experience in database development.
• Familiarity with mainstream data processing frameworks and technologies.
• Detail-oriented, data-sensitive, strong in logical thinking.

Responsibilities

• Work with multiple games, performing offline/real-time ETL tasks.
• Integrate and model data warehouse systems, maintain and optimize them.
• Design and implement ETL for data models, participating in processes.

Skills

Database development

Data processing frameworks (Hadoop, Hive, etc.)

Programming (Java, Scala, Python)

SQL

Logical thinking

Teamwork and communication

Education

Bachelor's degree in Mathematics, Statistics, or Computer-related field

Tools

AWS

Alibaba Cloud

Hadoop

Hive

Flink

Spark

Hudi

Job description

Job Responsibilities

1. Work with multiple games, responsible for offline/real-time ETL tasks across various business lines;
2. Responsible for integration and modeling of data warehouse systems, including maintenance and optimization;
3. Design and implement ETL for data models, participate in optimization of team ETL processes and solve technical issues;
4. Design and manage data quality monitoring and governance of the data warehouse.

Job Requirements

1. Bachelor's degree or above, mathematics, statistics, or computer-related majors preferred;
2. Over 4 years of experience in database development;
3. Familiar with mainstream data processing frameworks and technologies such as Hadoop, Hive, Flink, Spark, Hudi, and proficient in at least two of them;
4. Proficient in at least one programming language such as Java, Scala, or Python. Proficient in database technologies and SQL;
5. Detail-oriented, data-sensitive, strong in logical thinking, good team player with communication skills;
6. Experience with AWS or Alibaba Cloud big data components is prefered