DataOps Engineer & Team Lead - Big Data Pipelines

Absa Group; Sandton; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A leading African bank in Sandton is seeking a skilled Data Engineer to manage and optimize data pipelines within a multi-platform environment. The ideal candidate has over 3 years of experience in big data, with proficiency in Java, Scala, Python, and Hadoop. Responsibilities include team management, mentoring, and ensuring high-quality data solutions. Applicants should hold a Bachelor's degree in Information Technology. This role offers an opportunity to contribute to a significant data platform supporting critical operations.

Qualifications

• 3+ years’ experience working in Big data environment.
• Experience in managing a team for at least one year.
• Familiarity with Hadoop ecosystem.

Responsibilities

• Manage an assigned team through daily support tasks.
• Oversee development plans and provide mentorship.
• Identify and drive optimisation opportunities.

Skills

Big Data environments

Java

Scala

Python

Hadoop

Apache Spark

Kafka

SQL

Cross domain knowledge

Database design

Education

Bachelor's Degree in Information Technology

Job description

A leading African bank in Sandton is seeking a skilled Data Engineer to manage and optimize data pipelines within a multi-platform environment. The ideal candidate has over 3 years of experience in big data, with proficiency in Java, Scala, Python, and Hadoop. Responsibilities include team management, mentoring, and ensuring high-quality data solutions. Applicants should hold a Bachelor's degree in Information Technology. This role offers an opportunity to contribute to a significant data platform supporting critical operations.