Big Data Platform Engineer

Absa Group; Sandton; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A leading banking institution in South Africa is seeking an experienced Spark Administrator to support large-scale data platforms. The successful candidate will have over 5 years of hands-on experience in Spark administration, Linux, and Starburst/Trino. Responsibilities include installing and maintaining Apache Spark clusters, monitoring performance, and ensuring compliance with banking standards. This is an excellent opportunity to join a proud African group fostering regional and international expertise.

Qualifications

• 5+ years in Spark administration and big data platforms.
• Strong Linux system administration (RHEL preferred).
• Hands-on Starburst/Trino experience.

Responsibilities

• Install, configure, and maintain Apache Spark clusters.
• Monitor cluster performance and troubleshoot Spark jobs.
• Administer Linux servers and automate tasks using scripts (Bash/Python).
• Manage and optimize Starburst/Trino clusters and connectors.
• Ensure platform security and compliance with banking standards.

Skills

Spark administration

Linux system administration

Starburst/Trino

Hadoop ecosystem knowledge

Scripting (Bash, Python)

Authentication and security

Education

Bachelor's Degrees or Advanced Diplomas in Manufacturing, Engineering and Technology

Job description

Empowering Africa’s tomorrow, together…one story at a time.

With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.

Job Summary

Seeking an experienced Spark Administrator with strong Linux and Starburst/Trino skills to support large-scale data platforms in a regulated banking environment. Requires 5+ years of hands‑on experience in big data infrastructure and system operations.

Job Description

Key Responsibilities

• Install, configure, and maintain Apache Spark clusters.
• Monitor cluster performance and troubleshoot Spark jobs.
• Administer Linux servers and automate tasks using scripts (Bash/Python).
• Manage and optimize Starburst/Trino clusters and connectors.
• Ensure platform security, access control, and compliance with banking standards.
• Support data engineering and analytics teams with performance tuning.
• Maintain high availability for critical banking data pipelines.

Required Skills

• 5+ years in Spark administration and big data platforms.
• Strong Linux system administration (RHEL preferred).
• Hands‑on Starburst/Trino experience.
• Knowledge of Hadoop ecosystem (HDFS, Hive, Ranger).
• Scripting abilities (Bash, Python).
• Understanding of authentication, networking, and security.

Preferred

• Cloud experience (AWS/Azure/GCP).
• Familiarity with banking data workflows and governance.

Education

Bachelor's Degrees and Advanced Diplomas: Manufacturing, Engineering and Technology

Absa Bank Limited is an equal opportunity, affirmative action employer. In compliance with the Employment Equity Act 55 of 1998, preference will be given to suitable candidates from designated groups whose appointments will contribute towards achievement of equitable demographic representation of our workforce profile and add to the diversity of the Bank.

Absa Bank Limited reserves the right not to make an appointment to the post as advertised.