Data Engineer

AFGRI; Centurion; On-site; ZAR 200,000 - 300,000; Full time

Job summary

A prominent agricultural solutions company in Centurion is seeking a Data Engineer to design and maintain data-based solutions. Responsibilities include building secure data processing pipelines and ensuring data quality to support analytics. The ideal candidate will have a strong business focus and collaborate with cross-functional teams to govern the enterprise data platform.

Qualifications

• Experience in designing and maintaining efficient data pipelines.
• Strong understanding of data store design and architecture patterns.
• Knowledge of data quality assurance and optimization techniques.

Responsibilities

• Design, develop, and maintain data-based solutions.
• Build and maintain secure data processing pipelines.
• Identify and troubleshoot operational and data quality issues.

Job description

This role’s responsibility is to design, develop and maintain data-based solutions including ensuring that the operationalization of data pipelines and data stores are high-performing, efficient, organized, and reliable, given a set of business requirements and constraints.

The Data Engineer will build and maintain secure and compliant data processing pipelines by using different tools and techniques, and maintain various data services and frameworks to store and produce cleansed and enhanced datasets for analysis. This includes data store design using different architecture patterns based on business requirements.

The incumbent will help identify and troubleshoot operational and data quality issues and design, implement, monitor, and optimize data platforms to meet the data pipelines. Collaborate with cross-functional teams (internal and external) to ensure effective implementation, set-up, utilization and governance of the enterprise data platform across the organization.

This role contributes to the complete data function for data analytics, business intelligence, and advanced analytics. It requires a strong business focus, and the individual understands the strategy and direction of the business but focuses on how to underpin that with data.