Senior Data Engineer: AI & Real-Time Analytics Lead

Razer; Kampung Cheng; On-site; MYR 80,000 - 100,000; Full time

Job summary

A leading gaming company in Malaysia is seeking an experienced Data Engineer to lead the design of scalable data pipelines and architectures. The ideal candidate will have over 5 years in data engineering, with expertise in Python, SQL, and big data frameworks like Spark and Kafka. Responsibilities include developing automated workflows and collaborating with cross-functional teams. This role offers an opportunity to make a substantial impact in a fast-paced environment focused on innovations in gaming.

Qualifications

• 5+ years of experience in data engineering with focus on scalable data architectures.
• Expert proficiency in Python and SQL programming languages.
• Strong experience with big data frameworks: Apache Spark, Apache Flink, and Apache Kafka.

Responsibilities

• Lead the design and development of robust, scalable data pipelines for analytics and AI/ML workloads.
• Build and maintain data architectures including data warehouses, data lakes, and real-time streaming solutions.
• Collaborate with data scientists and stakeholders to deliver reliable data infrastructure.

Skills

Python

SQL

Apache Spark

Apache Flink

Apache Kafka

AWS Redshift

DBT

Docker

Kubernetes

Data governance

Education

Bachelor's degree in Computer Science, Data Engineering, Statistics

Tools

Apache Airflow

Data warehouses

Data lakes

Job description

A leading gaming company in Malaysia is seeking an experienced Data Engineer to lead the design of scalable data pipelines and architectures. The ideal candidate will have over 5 years in data engineering, with expertise in Python, SQL, and big data frameworks like Spark and Kafka. Responsibilities include developing automated workflows and collaborating with cross-functional teams. This role offers an opportunity to make a substantial impact in a fast-paced environment focused on innovations in gaming.