DataOps Engineer: Big Data Platform & Support Lead

Absa Group; Johannesburg; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A leading financial institution in Johannesburg is seeking an experienced Data Engineer to provide enterprise-wide application support. You will manage a team, optimize and build Big Data pipelines using Java, Scala, and Python, ensuring efficient data management and technical mentorship. Strong knowledge of Hadoop and its ecosystem is required, with at least 3 years of experience in the field. Competitive compensation and a collaborative work environment await the right candidate.

Qualifications

• 3+ years’ experience in Big Data environments, optimizing and building data pipelines.
• Minimum one year experience with Scala programming language.
• Minimum one year experience managing a team.

Responsibilities

• Manage an assigned team through day-to-day support tasks.
• Oversee development plans for the team and provide mentorship.
• Support pipelines end to end and build new data pipelines.
• Drive optimization opportunities across the environment.

Skills

Big data environment experience

Java programming

Scala programming

Python programming

Apache Spark experience

Hadoop ecosystem knowledge

Database design experience

SQL knowledge

Education

Bachelor's Degree in Information Technology

Tools

Hadoop

Kafka

Job description

A leading financial institution in Johannesburg is seeking an experienced Data Engineer to provide enterprise-wide application support. You will manage a team, optimize and build Big Data pipelines using Java, Scala, and Python, ensuring efficient data management and technical mentorship. Strong knowledge of Hadoop and its ecosystem is required, with at least 3 years of experience in the field. Competitive compensation and a collaborative work environment await the right candidate.