Data Engineer

Network It; Cape Town; On-site; ZAR 500,000 - 700,000; Full time

Job summary

A leading recruitment agency is seeking a skilled Data Engineer in Cape Town. You will manage database architecture and develop scalable data processes for investment research. Ideal candidates should have up to 3 years' experience in data analysis and strong skills in Python and SQL. This role offers significant growth opportunities within a systematic investment framework team.

Qualifications

• Up to 3 years' experience in database management and data analysis.
• Basic understanding of financial instruments and markets.
• Exceptional skills in Python and SQL.

Responsibilities

• Design and develop scalable data pipelines and ETL processes.
• Implement data models and optimize data storage.
• Collaborate with analysts for data exploration and visualization.

Skills

Database management

Data analysis

ETL processes

Python

SQL

Linux server administration

Git version control

Managing large datasets

Education

Matric / Grade 12

University Post Graduate Degree (Computer Science / Information Systems / Mathematics / Stats / Business Science / Actuarial)

Job description

Reference : BIT-CdP-1

We are looking for a skilled Data Engineer to join our clients' investment team to oversee their database architecture, data flow, and data processes.

The role involves efficiently managing the reception, transfer, processing, analysis, and integration of third-party systems for investment research and business operational processes.

The ideal candidate will possess expertise in version control and database solutions, while also adhering to the companies' collaborative team approach in line with their value framework.

Duties & Responsibilities

1. Design and develop scalable data pipelines and ETL processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
2. Implement data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing, and analysis.
3. Collaborate with quantitative analysts to understand their data requirements and provide necessary infrastructure and tools for data exploration, analysis, and visualization.
4. Ensure data quality and consistency by implementing data validation, cleaning, and transformation procedures.
5. Monitor and maintain the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
6. Troubleshoot and resolve data-related issues and performance bottlenecks in collaboration with the investment teams.
7. Evaluate and integrate new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.
8. Document data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain systems.
9. Stay up to date with industry trends, best practices, and emerging technologies in the field of data engineering.
10. Assist and collaborate on team-wide projects.
11. Contribute to the analytics platform from a Data Engineering perspective.
12. Assist and investigate ad-hoc data-related queries.

Skills & Experience Required

• Up to 3 years' experience with a specific focus on database management, data analysis, and producing ETL processes at scale is essential.
• Basic understanding of financial instruments and markets.
• Exceptional skill and experience in Python and SQL.
• Linux server administration.
• Git version control.
• Solid experience in managing and analysing large datasets.

Educational Requirements

• Matric / Grade 12 – Essential
• University Post Graduate Degree (Computer Science / Information Systems / Mathematics / Stats / Business Science / Actuarial).

Why This Role? This is an exciting opportunity offering fantastic growth and exposure as you become part of a leading systematic investment framework team.

Apply now! For more information contact: Chanel du Plessis, Senior IT Recruitment Consultant. Alternatively, email your CV to: J Ljbffr