Data Engineer

Network It; Cape Town; On-site; ZAR 200,000 - 300,000; Full time

Job summary

Network It is searching for a skilled Data Engineer to oversee database architecture and data processes within the investment team. The role involves designing ETL processes, ensuring data quality, and collaborating with analysts on data exploration. This exciting opportunity offers growth in a leading systematic investment framework team.

Qualifications

• Up to 3 years' experience in database management and ETL.
• Familiarity with financial instruments and markets.

Responsibilities

• Design and develop scalable data pipelines and ETL processes.
• Implement data models, schemas, and database structures.
• Ensure data quality through validation and cleaning procedures.

Skills

Python

SQL

Database Management

Data Analysis

ETL Processes

Version Control

Linux Administration

Education

Matric / Grade 12

University Post Graduate Degree (Computer Science / Information Systems / Mathematics / Stats / Business Science / Actuarial)

Job description

Reference : BIT-CdP-1

We are looking for a skilled Data Engineer to join our clients' investment team to oversee their database architecture, data flow, and data processes.

The role involves efficiently managing the reception, transfer, processing, analysis, and integration of third-party systems for investment research and business operational processes.

The ideal candidate will possess expertise in version control and database solutions, while also adhering to the companies' collaborative team approach in line with their value framework.

Duties & Responsibilities

1. Design and develop scalable data pipelines and ETL processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
2. Implement data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing, and analysis.
3. Collaborate with quantitative analysts to understand their data requirements and provide necessary infrastructure and tools for data exploration, analysis, and visualization.
4. Ensure data quality and consistency by implementing data validation, cleaning, and transformation procedures.
5. Monitor and maintain the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
6. Troubleshoot and resolve data-related issues and performance bottlenecks in collaboration with the investment teams.
7. Evaluate and integrate new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.
8. Document data pipelines, workflows, and technical specifications to facilitate knowledge sharing and system maintenance.
9. Stay up to date with industry trends, best practices, and emerging technologies in data engineering.
10. Assist and collaborate on team-wide projects.
11. Contribute to the analytics platform from a Data Engineering perspective.
12. Assist and investigate ad-hoc data-related queries.

Skills & Experience Required

• Up to 3 years' experience with a focus on database management, data analysis, and producing ETL processes at scale.
• Basic understanding of financial instruments and markets.
• Exceptional skill and experience in Python and SQL.
• Linux server administration.
• Git version control.
• Solid experience in managing and analyzing large datasets.

Educational Requirements

• Matric / Grade 12 – Essential
• University Post Graduate Degree (Computer Science / Information Systems / Mathematics / Stats / Business Science / Actuarial).

Why This Role? This is an exciting opportunity offering fantastic growth and exposure as you become part of a leading systematic investment framework team.

Apply now! For more information contact: Chanel du Plessis, Senior IT Recruitment Consultant or email your CV to [contact email].