Lead, Big Data

Atomic Recruitment Sea; Shah Alam; On-site; MYR 180,000 - 240,000; Full time

Job summary

Jora Malaysia is seeking an experienced Assistant Manager – Big Data & Data Solutions to lead large-scale data environments, design robust data pipelines, and deliver analytics solutions for MarTech and customer analytics. You will mentor junior engineers and collaborate across Marketing, Engineering, Product, and Strategy teams.

The role requires expertise in Spark, Hadoop, Kafka, Python, SQL, and cloud platforms.

Qualifications

• Experience designing enterprise big data systems with Spark, Hadoop, or Kafka.
• Strong Python and SQL skills with basics in Terraform or Docker.
• Experience with Huawei Cloud (DLI), Databricks, or Amazon EMR.
• Data warehousing and orchestration knowledge (Airflow, Snowflake, BigQuery, Redshift, Huawei DWS).
• Solid data modeling skills and ML basics; RDBMS and NoSQL experience.
• BI and MarTech familiarity with Power BI, Tableau, or QlikSense.
• Leadership in Agile/Scrum teams and mentoring juniors.

Responsibilities

• Architecture & System Design: Design, build, and maintain enterprise big data systems aligned with stakeholder requirements and industry best practices.
• Data Engineering & Pipelines: Develop, optimize, and maintain data processing solutions using Hadoop, Spark, and Kafka to guarantee data accuracy, consistency, and integrity.
• Advanced Analytics & ML: Apply predictive modeling, clustering, regression, and NLP techniques to build customer-centric data products and uncover actionable business insights.
• Cross-Functional Collaboration: Partner with Marketing, Engineering, Product, and Strategy teams to translate complex business requirements into clear technical specifications and data architectures.
• Team Leadership & Delivery: Lead, mentor, and manage junior engineers and analysts to deliver technical tasks and projects effectively.
• Governance & Security: Ensure full compliance with data privacy, security regulations and governance standards throughout the development lifecycle.
• Technology Modernization: Stay up to date with emerging trends in big data, AI/ML, and MarTech to introduce innovative methodologies to the organization.

Skills

Spark

PySpark

Hadoop

Kafka

Python

SQL

Terraform

Docker

Airflow

Databricks

Huawei Cloud

MSSQL

PostgreSQL

NoSQL

Power BI

Tableau

QlikSense

CDP/MarTech

Agile/Scrum

Leadership

Tools

Terraform

Docker

Airflow

Databricks

Huawei Cloud

Snowflake

BigQuery

Redshift

Job description

Jora Malaysia will close on 9th September 2026. Thank you for being with us, we are cheering you on as you continue your career journey.

Join the centralized technology powerhouse for a leading Malaysian conglomerate. Established in early 2000s, this centre of excellence focuses on driving digital transformation, process optimization, and large-scale IT innovation across multiple business units

About the Role

We are seeking an experienced and technical Assistant Manager – Big Data & Data Solutions to manage large-scale data environments, lead technical executions, and deliver high-impact analytics solutions—particularly supporting marketing technology (MarTech) and customer analytics. In this role, you will bridge the gap between business strategy and big data engineering by designing robust data pipelines, deploying predictive models, and ensuring data quality. You will also manage and mentor junior team members to ensure the successful delivery of key data initiatives in an Agile environment.

Responsibilities

• Architecture & System Design: Design, build, and maintain enterprise big data systems aligned with stakeholder requirements and industry best practices.
• Data Engineering & Pipelines: Develop, optimize, and maintain data processing solutions using Hadoop, Spark, and Kafka to guarantee data accuracy, consistency, and integrity.
• Advanced Analytics & Machine Learning: Apply predictive modeling, clustering, regression, and NLP techniques to build customer-centric data products and uncover actionable business insights.
• Cross-Functional Collaboration: Partner with Marketing, Engineering, Product, and Strategy teams to translate complex business requirements into clear technical specifications and data architectures.
• Team Leadership & Delivery: Lead, mentor, and manage junior engineers and analysts to deliver technical tasks and projects effectively.
• Governance & Security: Ensure full compliance with data privacy, security regulations and governance standards throughout the development lifecycle.
• Technology Modernization: Stay up to date with emerging trends in big data, AI/ML, and MarTech to introduce innovative methodologies to the organization.

Qualifications

• Big Data Technologies: Hands-on experience with big data ecosystems, specifically Spark (PySpark is a strong plus), Hadoop, or Kafka.
• Programming & Infrastructure: Strong proficiency in Python and SQL, alongside working knowledge of Terraform or Docker.
• Cloud Platforms: Experience with big data analytics platforms such as Huawei Cloud (DLI), Databricks, or Amazon EMR.
• Data Warehousing & Orchestration: Familiarity with data warehousing architectures and orchestrators like Airflow, Snowflake, BigQuery, Redshift, or Huawei DWS.
• Data Modeling & ML: Solid grasp of data modeling concepts (both supervised and unsupervised training/learning).
• Databases: Proven experience working with relational and non-relational databases, including MSSQL (preferred), PostgreSQL, and NoSQL solutions.
• Business Intelligence & MarTech: Experience with visualization tools like Power BI (preferred), Tableau, or QlikSense. Prior experience with CDP (Customer Data Platforms), MarTech tools, or the marketing industry is highly advantageous.
• Leadership & Agile: Proven ability to manage and upskill junior team members with experience working in Agile/Scrum development environments.