Data Engineer: Build Scalable Pipelines & Insights

FirstRand Limited; Johannesburg; On-site; ZAR 800,000 - 1,200,000; Full time

Job summary

FirstRand Limited is seeking a Data Engineer to expand and optimize our data and data pipeline architecture. The role focuses on building and refining data delivery for cross-functional teams, supporting analysts, scientists, and engineers, and ensuring scalable, secure data systems across multiple data centres.

The ideal candidate will design and implement ETL processes, leverage SQL and big data technologies, and drive improvements to data architecture to support next-generation products and

Qualifications

• Experience building and optimizing data pipelines.
• Proficiency with SQL and big data technologies.
• Experience with ETL processes and data integration.
• Experience with Hadoop platforms and large-scale data systems.
• Experience migrating data across databases/servers.
• Knowledge of data governance and quality.

Responsibilities

• Create and maintain optimal data pipeline architecture meeting functional and non-functional requirements.
• Identify and implement internal process improvements for data delivery and scalability.
• Build infrastructure for ETL from diverse sources using SQL and big data tech.
• Implement analytics tools to provide insights on key metrics.
• Collaborate with stakeholders to support data needs and issues.
• Keep data secure across national boundaries via multiple data centres.
• Develop scripts for maintenance, monitoring, and performance tuning.
• Lead innovation by evaluating big data technologies for platforms.
• Oversee large Hadoop platforms and support growing data needs.
• Enable and run data migrations across databases and servers.

Skills

Data pipeline

SQL

Big data

ETL

Hadoop

Data migration

Data governance

Tools

Ab Initio

Job description

FirstRand Limited is seeking a Data Engineer to expand and optimize our data and data pipeline architecture. The role focuses on building and refining data delivery for cross-functional teams, supporting analysts, scientists, and engineers, and ensuring scalable, secure data systems across multiple data centres.

The ideal candidate will design and implement ETL processes, leverage SQL and big data technologies, and drive improvements to data architecture to support next-generation products and