Big Data Operations & Automation Engineer

CEKAP LINK TECH SDN. BHD.; Kuala Lumpur; On-site; MYR 120,000 - 190,000; Full time

Job summary

CEKAP LINK TECH SDN. BHD. is seeking a Big Data Operations & Maintenance Engineer in Kuala Lumpur to manage automation, deployment, monitoring and data pipeline reliability.

You will analyze requirements, design solutions, deploy components, and maintain the data ops platform. The role requires expertise in Linux, open-source big data stacks, and programming in Python, Rust, Go or Java. You will handle production incidents and continuously improve system stability and automation, with

Qualifications

• Bachelor's degree or above in CS/IT with at least 3 years of relevant experience.
• Strong knowledge of Linux systems, administration and troubleshooting.
• Experience with open-source big data technologies (Hadoop, Kafka, StarRocks, Flink, ClickHouse).
• Hands-on deployment, operation and troubleshooting of big data platforms.
• Proficient in Python, Rust, Go or Java on Linux/Unix.
• Strong problem-solving and communication skills with willingness to learn and share knowledge.
• Ability to respond to production incidents outside normal hours when required.

Responsibilities

• Manage and develop automation tools for system operations, deployment, monitoring and maintenance.
• Participate in requirement analysis, solution design, development, deployment and ongoing maintenance of the data operations platform.
• Monitor data collection and processing workflows, identify data quality issues, and support stability and reliability of data pipelines.
• Perform daily operations and maintenance of production environments, including server deployment, configuration, monitoring, performance optimisation and troubleshooting.
• Monitor and maintain big data platforms, respond to production incidents, and troubleshoot system or data processing issues.
• Support continuous improvement of system stability, operational efficiency and automated deployment processes.
• Prepare and maintain technical documentation and troubleshooting records.

Skills

Linux administration

Troubleshooting

Python

Rust

Golang

Java

Cross-team collaboration

Education

Bachelor's degree in Computer Science/IT

Tools

Hadoop

Kafka

StarRocks

Flink

ClickHouse

Job description

CEKAP LINK TECH SDN. BHD. is seeking a Big Data Operations & Maintenance Engineer in Kuala Lumpur to manage automation, deployment, monitoring and data pipeline reliability.

You will analyze requirements, design solutions, deploy components, and maintain the data ops platform. The role requires expertise in Linux, open-source big data stacks, and programming in Python, Rust, Go or Java. You will handle production incidents and continuously improve system stability and automation, with