Data Engineering Lead

Kerridge Commercial Systems; Johannesburg; Hybrid; ZAR 900,000 - 1,200,000; Full time

Job summary

A leading company specializing in integrated business management solutions seeks a Data Engineering Lead. In this role, you will spearhead the creation of a Datalake and engage with various stakeholders, leveraging data to drive business decisions. Ideal candidates will have extensive experience in data engineering, a commercial mindset, and strong leadership skills.

Qualifications

• Proven experience in Data Engineering or similar roles.
• Strong communication and collaboration skills.
• Ability to manage C-Suite stakeholders effectively.

Responsibilities

• Define and implement strategic data architecture.
• Design and maintain scalable data pipelines.
• Collaborate with data scientists to deliver solutions.

Skills

Databricks

SQL

Python

Scala

Java

Pyspark

Data warehousing concepts

ETL processes

Problem-solving

Communication

Education

Bachelor's degree in Computer Science or Engineering

Tools

AWS

Azure

Oracle Cloud

Job description

At Klipboardwe've introduced a flexible hybrid work policy, where employees spend three days in the office and two days working from home. This approach promotes a balanced work environment that combines office collaboration with the comfort and convenience of remote work."

Klipboard provides specialist software, services and support to deliver fully integrated trading and business management solutions to companies in the distributive trade – wherever they are in the world. With a unique depth of knowledge and experience in ERP / SaaS solutions, Klipboard has a wide range of clients includes wholesalers, distributors, merchants and retailers from small traders to multinational enterprises. Klipboard has offices in the UK, Ireland, The Netherlands, South Africa, Kenya and North America. Our mission is simple : to design and deliver high performance, integrated ERP solutions that enable our distributive trade customers to source effectively, stock efficiently, sell profitably and service competitively

Great Software solutions don’t happen without great people. We have the best software solutions for our market because we have the best people.

We have a new and exciting opportunity for a Data Engineering Lead to join our newly created Group Technology function. Working closely and supporting the Chief Information & Data Officer you will lead the delivery of a Datalake for the global business and building data pipelines, that support commercial data propositions we sell to our customer and deliver data to your internal stakeholders to manage business performance . You will engage with Product managers and stakeholders both internally and externally, to focus on revenue growth and enhance decision making through the ‘Power of Data’ .

You will be adapt at managing C-Suite stakeholders, have a commercial data mindset, establishing strategies and methods covering all data use cases, Insights, Streaming, product integration / orchestration, Data science and multi-tenant architectures.

Key Responsibilities :

Duties include :

• Define and implement the strategic data architecture for the business
• Create and manage the delivery roadmap for Data engineering
• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks.
• Write efficient and optimized SQL queries for data extraction and transformation.
• Develop and maintain data integration workflows using Python, Scala, and Java / React
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
• Ensure data quality and integrity through rigorous testing and validation.
• Monitor and troubleshoot data pipeline performance and reliability.
• Implement best practices for data management, security, and governance.
• Stay up-to-date with the latest industry trends and technologies in data engineering.
• Implementing plans to educate the organisation on the ‘Power of Data’
• Confidently talk to external customers and business events, about how KCS unleashes the power of data for its growth
• Lead and grow a team of expert data engineers

Skills, Knowledge and Experience :

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineering or in a similar role.
• Proficiency in Databricks, SQL, Python, Scala, and Java, Oracle, Pyspark
• Experience in building Graph, Vector, NoSQL and data lakehouse architectures
• Strong understanding of data warehousing concepts and ETL processes.
• Experience with on-premise and cloud platform architectures (AWS, Azure and Oracle Cloud)
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.
• Ability to work in a fast-paced, dynamic environment.
• Outstanding verbal and written communication skills
• Excellent interpersonal and organisational skills
• Strong commercial awareness in all areas

Company Info

You may also have seen from our recent posts that we are excited to begin sharing our new company name – Klipboard. Kerridge Commercial Systems (KCS) is becoming Klipboard and our new brand is designed to bring together our expertise across distribution, automotive, retail, rental, transport management, manufacturing, and field service management. We have offices based across the world and we are looking for talented individuals to join our growing teams. Due to our growth over the last few years it is an exciting time to join us as we enter our next chapter! At Klipboard we've introduced a flexible hybrid work policy, where employees spend three days in the office and two days working from home. This approach promotes a balanced work environment that combines office collaboration with the comfort and convenience of remote work."

As a global company, we value and respect the diversity of our workforce, aiming to empower everyone to embrace each other's differences. We are committed to creating an inclusive workplace where diversity, equity, and inclusion are integral to our company and culture. We recognize the benefits of a diverse workforce, where creativity and valuing differences enable us all to thrive and sparks innovation.

If you require any help, adjustments and / or support during the interview and offer process then please advise our TA or HR team.

Research shows that women and other underrepresented groups are less likely to apply for a role unless they meet every listed requirement. However, we recognise that skills and experience come in many forms, and we encourage you to apply even if you don’t meet every criterion. If you are passionate about this role and believe you have the right mindset and transferrable skills, we would love to hear from you!

To all recruitment agencies : Klipboard does not accept agency speculative resumes. At present we only accept CV’s from Agencies on our PSL who have been assigned specific position / s. Please do not forward resumes to our careers site or direct to Klipboard employee as this does not constitute an introduction and Klipboard retrospectively will not be liable for any candidate ownership or fees related to unsolicited resumes. If you wish to be considered for our PSL then please emailhowever please note we receive a high volume of requests and we are unable to accept them all

LI-Hybrid

Create a job alert for this search