Data Engineer

Cape National Recruitment Pty Ltd; Centurion; Hybrid; ZAR 200,000 - 300,000; Full time

Job summary

A recruitment agency in Centurion is seeking a Data Engineer for a permanent role. The position involves building and maintaining data processing pipelines, ensuring data quality, and collaborating with teams for effective data governance. Applicants should have a BCom in IT or similar, with experience in Azure-based solutions, Python, and SQL. This hybrid role offers the opportunity to work flexibly while contributing to the agricultural industry.

Qualifications

• 2 – 4 years of working experience in an IT environment.
• Experience in working on Azure-based data solutions.
• Experience gathering requirements and translating them into designs.
• Experience in the Agricultural sector is an advantage.

Responsibilities

• Build and maintain secure data processing pipelines.
• Design, develop, and maintain data-based solutions.
• Identify and troubleshoot operational and data quality issues.
• Collaborate with cross-functional teams for effective data governance.

Skills

Python

SQL

Data Engineering tools (Azure Data Engineer)

Report writing skills

Excellent verbal and written communication skills

Education

BCom Information Technology qualification

bachelors degree in computer science

ITIL or COBIT certification

Data Engineering tools (Azure Data Engineer) certification

Tools

Microsoft Azure Data suite

Project Management Tools

Job description

Overview

Our client in Centurion in the agricultural industry, has a permanent role available for a Data Engineer.

This position reports to the Team Lead: Business Information.

The client is flexible when it comes to a hybrid way of working.

Responsibilities

• The Data Engineer helps stakeholders understand the data through exploration, and build and maintain secure and compliant data processing pipelines by using different tools and techniques.
• You maintain various data services and frameworks to store and produce cleansed and enhanced datasets for analysis.
• This includes data store design using different architecture patterns based on business requirements.
• The Data Engineer’s responsibility is to design, develop and maintain data-based solutions this includes ensuring that the operationalization of data pipelines and data stores are high-performing, efficient, organized, and reliable, given a set of business requirements and constraints.
• You help to identify and troubleshoot operational and data quality issues. You also design, implement, monitor, and optimize data platforms to meet the data pipelines.
• Collaborate with cross-functional teams (internal and external) to ensure effective implementation, set-up, utilization and governance of the enterprise data platform across the organization.
• This role contributes to the complete data function for data analytics, business intelligence, advanced analytics.
• This role requires a strong business focus, and the induvial understands the strategy and direction of the business but focuses on how to underpin that with data.
• This position reports to the Team Lead: Business Information.

Required Education / Training

• BCom Information Technology qualification / bachelor’s degree in computer science / Engineering (IT) degree or similar
• Data Engineering tools (Azure Data Engineer) certification will be an added advantage
• ITIL or COBIT certification

Required Work Experience

• 2 – 4 years of working experience in an IT environment
• Experience in working on IT enterprise Azure-based data solutions
• Experience with Python and SQL
• Experience in gathering requirements and transition it to designs and outcomes
• Experience working in the Agricultural sector will be an advantage

Key Performance Areas

• Strategic Direction
• Information Technology Operations
• IT Project Execution
• People Management
• Financial Management
• Governance and Compliance

Technical Knowledge / Competencies

• Microsoft Azure Data suite
• Data and Business intelligence enablement knowledge
• Business intelligence rendering tools
• Working knowledge of Project Management Tools
• Excellent verbal and written communication skills
• Report writing skills
• IT Security would be an added advantage
• People change management skills

Behavioural Competencies

• Analytical ability
• Attention to detail
• Ability to tie together technologies and architectures to address requirements
• Planning and organizing
• Strong communication skills
• Teamwork
• Change agent
• Work under pressure
• Assertiveness
• Interpersonal skills