Specialist Data Engineer

Absa Ins & Fin Advise(Pty; Johannesburg; Presencial; ZAR 900 000 - 1 300 000; Tempo integral

Resumo da oferta

Absa is seeking a Data Architect/Data Engineer to design and implement data solutions that support a business area. You will work across squads to develop, test and document data pipelines for retrieval, processing, storage and distribution.

Responsibilities include designing scalable architectures, leveraging SQL and NoSQL databases, building CI/CD pipelines and automating tasks with configuration tools. You will mentor peers and ensure secure, resilient data platforms aligned with group

Qualificações

• Strong understanding of data architecture and how it supports business requirements.
• Experience designing data solutions across storage, processing and distribution.
• Ability to translate architecture directions into concrete data pipelines and blueprints.
• Familiarity with relational and No-SQL databases and integration/streaming platforms.
• Proven track record building scalable data processing and analytics tools.
• Experience with CI/CD pipelines and deploying applications to multiple environments.

Responsabilidades

• Understand the technical landscape and bank-wide architecture to design data solutions.
• Translate business requirements into data solution designs and build components.
• Participate in design thinking to deliver data solution blueprints.
• Leverage relational and No-SQL databases and streaming platforms for data pipelines.
• Design data retrieval, storage and distribution across development lifecycle.
• Develop high-quality data processing and analytics tools and document code.
• Create and maintain CI/CD pipelines and deploy to multi-site environments.
• Automate tasks with tools like Ansible and Chef.
• Debug existing source code and refine features.
• Assemble large, complex data sets meeting business needs.

Conhecimentos

Data architecture

Data engineering

CI/CD pipelines

Jenkins

Ansible

Chef

Relational databases

NoSQL databases

Ferramentas

Jenkins

Ansible

Chef

Relational databases

NoSQL databases

Descrição da oferta de emprego

Empowering Africa's tomorrow, together...one story at a time.

With over 100 years of rich history and strongly positioned as a local bank with regional and international expertise, a career with our family offers the opportunity to be part of this exciting growth journey, to reset our future and shape our destiny as a proudly African group.

Belonging at Absa

Absa is committed to creating an inclusive workplace where everyone can thrive. We are an equal opportunity employer and welcome applications from suitably qualified individuals from diverse backgrounds. In support of our Diversity, Equity, Inclusion and Belonging (DEIB) commitments and Employment Equity objectives, preference may be given to candidates from underrepresented designated groups, including persons with disabilities. We encourage applicants who may require reasonable accommodation during the recruitment process to let us know so that appropriate support can be provided.

Job Summary

Work embedded as a member of squad OR; across multiple squads to produce, test, document and review algorithms & data specific source code that supports the deployment & optimisation of data retrieval, processing, storage and distribution for a business area.

Job Description

Data Architecture & Data Engineering

• Understand the technical landscape and bank wide architecture that is connected to or dependent on the business area supported in order to effectively design & deliver data solutions (architecture, pipeline etc.)
• Translate / interpret the data architecture direction and associated business requirements & leverage expertise in analytical & creative problem solving to synthesise data solution designs (build a solution from its components) beyond the analysis of the problem
• Participate in design thinking processes to successfully deliver data solution blueprints
• Leverage state of the art relational and No-SQL databases as well integration and streaming platforms do deliver sustainable business specific data solutions.
• Design data retrieval, storage & distribution solutions (and OR components thereof) including contributing to all phases of the development lifecycle e.g. design process
• Develop high quality data processing, retrieval, storage & distribution design in a test driven & domain driven / cross domain environment
• Build analytics tools that utilize the data pipeline by quickly producing well-organised, optimized, and documented source code & algorithms to deliver technical data solutions
• Create & Maintain Sophisticated CI / CD Pipelines (authoring & supporting CI/CD pipelines in Jenkins or similar tools and deploy to multi-site environments - supporting and managing your applications all the way to production)
• Automate tasks through appropriate tools and scripting technologies e.g. Ansible, Chef
• Debug existing source code and polish feature sets.
• Assemble large, complex data sets that meet business requirements & manage the data pipeline
• Build infrastructure to automate extremely high volumes of data delivery
• Create data tools for analytics and data science teams that assist them in building and optimizing data sets for the benefit of the business
• Ensure designs & solutions support the technical organisation principles of self-service, repeatability, testability, scalability & resilience
• Apply general design patterns and paradigms to deliver technical solutions
• Inform & support the infrastructure build required for optimal extraction, transformation, and loading of data from a wide variety of data sources
• Support the continuous optimisation, improvement & automation of data processing, retrieval, storage & distribution processes
• Ensure the quality assurance and testing of all data solutions aligned to the QA Engineering & broader architectural guidelines and standards of the organisation
• Implement & align to the Group Security standards and practices to ensure the undisputable separation, security & quality of the organisation's data
• Meaningfully contribute to & ensure solutions align to the design & direction of the Group Architecture & in particular data standards, principles, preferences & practices. Short term deployment must align to strategic long term delivery.
• Meaningfully contribute to & ensure solutions align to the design and direction of the Group Infrastructure standards and practices e.g. OLA's, IAAS, PAAS, SAAS, Containerisation etc.
• Monitor the performance of data solutions designs & ensure ongoing optimization of data solutions
• Stay ahead of the curve on data processing, retrieval, storage & distribution technologies & processes (global best practices & trends) to ensure best practice

People

• Coach & mentor other engineers
• Conduct peer reviews, testing, problem solving within and across the broader team
• Build data science team capability in the use of data solutions

Risk & Governance

• Identify technical risks and mitigate these (pre, during & post deployment)
• Update / Design a