Data Engineer: Build Scalable Data Pipelines for Impact

Absa Ins & Fin Advise(Pty; Johannesburg; Vor Ort; ZAR 900.000 - 1.300.000; Vollzeit

Zusammenfassung

Absa is seeking a Data Architect/Data Engineer to design and implement data solutions that support a business area. You will work across squads to develop, test and document data pipelines for retrieval, processing, storage and distribution.

Responsibilities include designing scalable architectures, leveraging SQL and NoSQL databases, building CI/CD pipelines and automating tasks with configuration tools. You will mentor peers and ensure secure, resilient data platforms aligned with group

Qualifikationen

• Strong understanding of data architecture and how it supports business requirements.
• Experience designing data solutions across storage, processing and distribution.
• Ability to translate architecture directions into concrete data pipelines and blueprints.
• Familiarity with relational and No-SQL databases and integration/streaming platforms.
• Proven track record building scalable data processing and analytics tools.
• Experience with CI/CD pipelines and deploying applications to multiple environments.

Aufgaben

• Understand the technical landscape and bank-wide architecture to design data solutions.
• Translate business requirements into data solution designs and build components.
• Participate in design thinking to deliver data solution blueprints.
• Leverage relational and No-SQL databases and streaming platforms for data pipelines.
• Design data retrieval, storage and distribution across development lifecycle.
• Develop high-quality data processing and analytics tools and document code.
• Create and maintain CI/CD pipelines and deploy to multi-site environments.
• Automate tasks with tools like Ansible and Chef.
• Debug existing source code and refine features.
• Assemble large, complex data sets meeting business needs.

Kenntnisse

Data architecture

Data engineering

CI/CD pipelines

Jenkins

Ansible

Chef

Relational databases

NoSQL databases

Tools

Jenkins

Ansible

Chef

Relational databases

NoSQL databases

Jobbeschreibung

Absa is seeking a Data Architect/Data Engineer to design and implement data solutions that support a business area. You will work across squads to develop, test and document data pipelines for retrieval, processing, storage and distribution.

Responsibilities include designing scalable architectures, leveraging SQL and NoSQL databases, building CI/CD pipelines and automating tasks with configuration tools. You will mentor peers and ensure secure, resilient data platforms aligned with group