Data Engineer

Boardroom Appointments; Johannesburg; On-site; ZAR 500,000 - 900,000; Full time

Job summary

Boardroom Appointments is seeking a data engineering professional to design and optimize ETL pipelines for enterprise data assets in Johannesburg. You will collect, transform, and load data from multiple source systems to support business intelligence and analytics initiatives.

The role requires strong Python, PySpark, SQL and Scala skills, experience with SAS and Ab Initio, and a solid grounding in data warehousing concepts. Collaboration with architects and BI teams is essential.

Qualifications

• Bachelor's degree in CS, engineering or information systems.
• 3–5 years in ETL/data integration.
• Experience with SAS and Ab Initio.
• Proficiency in Python, PySpark, SQL and Scala.
• Experience with data warehousing and data integration testing.

Responsibilities

• Control expenditure and identify process improvements to contain and reduce costs
• Manage acquisition, consumption and deployment of data for operational use
• Provide required support in designing and developing systems and solutions
• Contribute to business analysis processes
• Manage data and system integration and testing
• Conduct research on architectural systems
• Develop, encourage and nurture collaborative relationships across area of specialisation
• Participate in planned activities that are appropriate for own development
• Build working relationships across teams and functional lines to enhance work delivery, collaboration and innovation

Skills

Python

PySpark

Scala

SQL

ETL development

Data warehousing

Education

Bachelor's Degree in Computer Science, Engineering or Information Systems

Tools

SAS

Ab Initio

Job description

To ensure effective movement, collection, integration, storage and provisioning of data to meet business objectives through sound understanding of business unit requirements and frequent collaboration with relevant stakeholders (such as Enterprise Architecture, Database and Solution Architects, Business Intelligence Developers, Data Scientists and Product Owners, etc)

Duties and responsibilities:

• Control expenditure and identify process improvements to contain and reduce costs
• Manage acquisition, consumption and deployment of data for operational use
• Provide required support in designing and developing systems and solutions
• Contribute to business analysis processes
• Manage data and system integration and testing
• Conduct research on architectural systems
• Develop, encourage and nurture collaborative relationships across area of specialisation
• Participate in planned activities that are appropriate for own development
• Build working relationships across teams and functional lines to enhance work delivery, collaboration and innovation

Qualifications and experience:

• Minimum Qualification - Bachelors Degree in Computer Science, Engineering or Information Systems
• Experience - 3 to 5 years in Extract, Transform and Load (ETL) of data from source systems or experience in data integration for consumption use cases
• SAS
• Ab Initio
• Python, PySpark SQL, Scala
• SQL, ETL development, and Data warehousing