Om Bank - Data Streaming Engineer

Old Mutual South Africa; Johannesburg; On-site; ZAR 500 000 - 700 000; Full time

Job summary

A leading financial services company is looking for a Mid-Senior Level Data Engineer to build and maintain real-time data pipelines in Johannesburg. The ideal candidate should have 3-5 years of experience with AWS, Kafka, and data warehousing. Responsibilities include collaborating with various teams to meet data needs and mentoring junior engineers. This full-time role offers an exciting opportunity to work with cutting-edge technology.

Qualifications

• 3-5 years of experience with designing and developing streaming data pipelines using AWS.
• Experience with data warehousing and data marts development.
• Familiarity with Data Vault and Dimensional modeling techniques.

Responsibilities

• Build and maintain real-time data pipelines.
• Collaborate with teams to analyze data needs.
• Mentor other engineers and conduct code reviews.

Skills

Action Planning

Business Requirements Analysis

Database Administration

Data Management

Data Modeling

User Requirements Documentation

Education

Bachelor's Degree in Computer Science or related fields

Tools

AWS

Kafka

AWS Kinesis

redPanda

Confluence

Job description

Job Description

At OM Bank, we strive to attract great people who are passionate about coming together for a higher purpose—building something unique and aspirational, always aiming to be the best they can be.

We are rooted in our purpose of inspiring and enabling our customers to grow and sustain their prosperity.

Build, enhance, and maintain our real-time data pipeline.

Work with various infrastructure and operations teams to maintain our data infrastructure.

As a senior engineer on the Data Streaming Platform team, you will be responsible for developing and maintaining data ingestion pipelines vital to the continued growth of the bank.

You will collaborate with many teams across the bank to understand data needs and turn them into platforms and services, monitor and maintain the health of the data streams, and have an impact on the data ecosystem within Square.

Key Result Areas

Operational Delivery

Build, enhance, and maintain our real-time data pipeline.

Work with various infrastructure and operations teams to maintain our data infrastructure.

Be self-driven in identifying and documenting feature gaps, and designing and implementing solutions to them.

Help build, modernize, and maintain services and tooling to ensure resiliency, fix data discrepancies, and enhance the customer experience.

Monitor daily execution, diagnose and log issues, and fix pipelines to ensure SLAs are met with internal stakeholders.

Mentor other engineers and help them grow; code reviews, guidance on best practices, leveraging your experience in the field.

Technical Leadership

Participate in the engineering and other discipline's community of practice.

Share AWS knowledge and practical experience with community.

Challenge and contribute to development of architectural principals and patterns.

Compliance

Ensure solutions adhere to Olympus patterns, guidelines and standards.

Operate within project environments and participate in continuous improvement efforts.

Delivery Management

Follow and participate in defined ways of work including, but not limited to, sprint planning, backlog grooming, retrospectives, demos, and PI planning.

Role Requirements

Experience of developing solutions in the cloud.

Min of 3 - 5 years' experience with designing and developing streaming Data Pipelines for Data Ingestion or Transformation using AWS technologies.

Experience with distributed log systems, such as Kafka and AWS Kinesis.

redPanda or Confluence experience advantageous.

Experience in developing data warehouses and data marts.

Experience in Data Vault and Dimensional modelling techniques.

Experience working with automated data warehousing solutions would be advantageous.

Qualifications

Bachelor's Degree in Computer Science or similar fields like Information Systems, Big Data, etc.

AWS Data Engineer Certification would be advantageous.

Related Technical certifications.

Skills

Action Planning, Business Requirements Analysis, Computer Literacy, Database Administration, Database Reporting, Data Compilation, Data Controls, Data Management, Data Modeling, Executing Plans, Gaps Analysis, Information Technology (IT) Support, IT Architecture, IT Implementation, IT Network Security, Market Analysis, Test Case Management, User Requirements Documentation.

Competencies

Action Oriented

Business Insight

Cultivates Innovation

Drives Results

Ensures Accountability

Manages Complexity

Optimizes Work Processes

Persuades

Education

Bachelors Degree (B)

Closing Date

03 November 23:59

Seniority Level

Mid-Senior level

Employment Type

Full-time

Job Function

Information Technology