Data Engineer

Kerridge Commercial Systems Corp; Johannesburg; Hybrid; ZAR 550,000 - 900,000; Full time

Job summary

A leading company in integrated trading and business management solutions is seeking a Data Engineer for their Johannesburg office. This role involves managing a Datalake, building data pipelines, and engaging with product managers to enhance decision-making. If you have a strong background in Data Engineering and are passionate about leveraging data to drive performance, we encourage you to apply.

Qualifications

• Proven experience as a Data Engineer or similar role.
• Strong understanding of ETL processes and data warehousing.
• Ability to work in a fast-paced dynamic environment.

Responsibilities

• Implement and evolve the strategic data architecture for the business.
• Design, develop, and maintain scalable data pipelines and ETL processes.
• Collaborate with data scientists and stakeholders to deliver solutions.

Skills

Data Engineering

SQL

Python

Scala

Java

Data Architecture

ETL Processes

Data Warehousing

Cloud Platforms

Communication

Education

Bachelor's degree in Computer Science/Engineering

Tools

Databricks

Oracle

AWS

Azure

Hadoop

Spark

Job description

At Klipboard weve introduced a flexible hybrid work policy where employees spend three days in the office and two days working from home. This approach promotes a balanced work environment that combines office collaboration with the comfort and convenience of remote work.

Klipboard provides specialist software services and support to deliver fully integrated trading and business management solutions to companies in the distributive trade wherever they are in the world. With a unique depth of knowledge and experience in ERP / SaaS solutions Klipboard has a wide range of clients includes wholesalers distributors merchants and retailers from small traders to multinational enterprises. Klipboard has offices in the UK Ireland The Netherlands South Africa Kenya and North America. Our mission is simple : to design and deliver high performance integrated ERP solutions that enable our distributive trade customers to source effectively stock efficiently sell profitably and service competitively

We have a new and exciting opportunity for a Data Engineer to join our newly created Group Technology function. Working closely and supporting the Chief Information & Data Officer you will lead the delivery of a Datalake for the global business and building data pipelines that support commercial data propositions we sell to our customer and deliver data to your internal stakeholders to manage business performance . You will engage with Product managers and stakeholders both internally and externally to focus on revenue growth and enhance decision making through the Power of Data .

You will be adapt at managing the importance of demand have a commercial data mindset establishing strategies and methods covering all data use cases Insights Streaming product integration / orchestration Data science and multitenant architectures.

Key Responsibilities :

Duties include :

• Implement evolve the strategic data architecture for the business
• Manage the data delivery roadmap for the data across the function
• Design develop and maintain scalable data pipelines and ETL processes using Databricks.
• Write efficient and optimized SQL queries for data extraction and transformation.
• Develop and maintain data integration workflows using Python Scala and Java / React
• Collaborate with data scientists analysts and other stakeholders to understand data requirements and deliver solutions.
• Ensure data quality and integrity through rigorous testing and validation.
• Monitor and troubleshoot data pipeline performance and reliability.
• Stay uptodate with the latest industry trends and technologies in data engineering.

Skills Knowledge and Experience :

• Bachelors degree in Computer Science Engineering or a related field.
• Proven experience as a Data Engineer or in a similar role.
• Proficiency in Databricks SQL Python Scala and Java Oracle
• Experience with building Graph Vector NoSQL and data lakehouse architectures
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with onpremise and cloud platform architectures (AWS Azure and Oracle Cloud)
• Excellent problemsolving skills and attention to detail.
• Strong communication and collaboration skills.
• Ability to work in a fastpaced dynamic environment.
• Outstanding verbal and written communication skills
• Excellent interpersonal and organisational skills
• Strong commercial awareness in all areas

Company Info

You may also have seen from our recent posts that we are excited to begin sharing our new company name Klipboard. Kerridge Commercial Systems (KCS) is becoming Klipboard and our new brand is designed to bring together our expertise across distribution automotive retail rental transport management manufacturing and field service management. We have offices based across the world and we are looking for talented individuals to join our growing teams. Due to our growth over the last few years it is an exciting time to join us as we enter our next chapter! At Klipboard weve introduced a flexible hybrid work policy where employees spend three days in the office and two days working from home. This approach promotes a balanced work environment that combines office collaboration with the comfort and convenience of remote work.

As a global company we value and respect the diversity of our workforce aiming to empower everyone to embrace each others differences. We are committed to creating an inclusive workplace where diversity equity and inclusion are integral to our company and culture. We recognize the benefits of a diverse workforce where creativity and valuing differences enable us all to thrive and sparks innovation.

If you require any help adjustments and / or support during the interview and offer process then please advise our TA or HR team.

Research shows that women and other underrepresented groups are less likely to apply for a role unless they meet every listed requirement. However we recognise that skills and experience come in many forms and we encourage you to apply even if you dont meet every criterion. If you are passionate about this role and believe you have the right mindset and transferrable skills we would love to hear from you!

To all recruitment agencies : Klipboard does not accept agency speculative resumes. At present we only accept CVs from Agencies on our PSL who have been assigned specific position / s. Please do not forward resumes to our careers site or direct to Klipboard employee as this does not constitute an introduction and Klipboard retrospectively will not be liable for any candidate ownership or fees related to unsolicited resumes. If you wish to be considered for our PSL then please email however please note we receive a high volume of requests and we are unable to accept them all

LIHybrid

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full-Time

Experience : years

Vacancy : 1

Create a job alert for this search

Data Engineer • Johannesburg, Gauteng, South Africa