Data Engineer

Swan iT Recruitment Ltd

Cape Town

On-site

ZAR 480,000 - 750,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Swan iT Recruitment Ltd is seeking a Data Engineer in Cape Town to design and maintain scalable data pipelines and ETL processes that consolidate data from diverse sources into a centralized data warehouse or data lake.

You will build data models, ensure data quality, collaborate with analysts, and monitor performance and security of data systems while adopting new technologies. The role requires Python and SQL expertise and a postgraduate degree in CS/IS/Maths/Stats/Business/Actuarial.

Qualifications

  • Up to 3 years’ experience with database management, data analysis and ETL at scale.
  • Basic understanding of financial instruments and markets.
  • Exceptional skill and experience in Python and SQL.

Responsibilities

  • Design and develop scalable data pipelines and ETL processes to collect, process and integrate data into a central data warehouse or data lake.
  • Implement data models, schemas and database structures to optimize data storage for efficient retrieval, writing and analysis.
  • Collaborate with analysts to understand data requirements and provide infrastructure and tools for data exploration and visualization.
  • Ensure data quality and consistency via validation, cleaning and transformation procedures.
  • Monitor and maintain performance, availability, and security of data systems and processing frameworks.

Skills

Python
SQL
ETL
Data pipelines
Data modeling
Data quality
Communication

Education

Postgraduate degree (CS/IS/Math/Stats/Business/Actuarial)

Job description

Duties & Responsibilities
  • Design and develop scalable data pipelines and ETL (Extract, Transform, Load) processes to collect, process, and integrate data from various sources into a centralized data warehouse or data lake.
  • Implementing data models, schemas, and database structures to organize and optimize data storage for efficient data retrieval, writing and analysis.
  • Collaborating with quantitative and analysts to understand their data requirements and provide them with the necessary infrastructure and tools for data exploration, analysis, and visualization.
  • Ensuring data quality and consistency by implementing data validation, cleaning, and transformation procedures.
  • Monitoring and maintaining the performance, availability, and security of data systems, including database servers, data warehouses, and data processing frameworks.
  • Troubleshooting and resolving data-related issues and performance bottlenecks in collaboration with the investment teams.
  • Evaluating and integrating new data technologies, tools, and frameworks to improve data infrastructure and processing capabilities.
  • Documenting data pipelines, workflows, and technical specifications to facilitate knowledge sharing and maintain system.
  • Keeping up-to-date with industry trends, best practices, and emerging technologies in the field of data engineering.

General:

  • Assist and collaborate on team wide projects.
  • Contribute to the analytics platform to know what is required from a Data Engineering perspective.
  • Assist and investigate ad-hoc data related queries.
Desired Experience & Qualification

REQUIRED EXPERIENCE

  • Up to 3 years’ experience with a specific focus in database management, data analysis and have produced ETL processes at scale are essential.
  • Basic understanding of financial instruments and markets.
  • Exceptional skill and experience in Python and SQL.

REQUIRED QUALIFICATIONS

  • University Post Graduate Degree (Computer Science/Information Systems/Maths/Stats/Business Science/Actuarial).
  • Strong programming skills in Python and SQL.

KEY COMPETENCIES

  • Excellent interpersonal skills, excellent communication skills oral and written.
  • Aptitude in decision-making and problem-solving.
  • Strong work ethic, self-motivated, driven and results oriented.
  • Ability to listen and respond to new ideas, input and diverse perspectives.
  • High levels of self-confidence, assertive as well as healthy levels of EQ.
  • Energetic problem-solver.
  • Structured work style, attention to detail and accuracy is of the utmost importance.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer Jhb - Northern Suburbs
Data Engineer Jhb - Northern Suburbs

Psybergate • Johannesburg

On-site
ZAR 1,000,000 - 1,500,000
Data Engineer
Data Engineer

Rifumo Empowerment Holdings • Gauteng

On-site
ZAR 334,800 - 558,000
Data Engineer
Data Engineer

Indsafri • South Africa

On-site
ZAR 600,000 - 900,000
Senior Data Engineer
Senior Data Engineer

Future Fit • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Data Engineer
Data Engineer

Uyandiswa Project Management Services • Johannesburg

On-site
ZAR 600,000 - 900,000
Data Engineer
Data Engineer

Nedbank • Johannesburg

On-site
ZAR 900,000 - 1,200,000
Data Engineer
Data Engineer

Tumaini Consulting • Sandton

On-site
ZAR 600,000 - 900,000
Data Engineer
Data Engineer

Boardroom Appointments • Johannesburg

On-site
ZAR 500,000 - 900,000
Data Engineer
Data Engineer

Capitec • Stellenbosch

On-site
ZAR 600,000 - 1,000,000
Data Engineer - ETL, AWS & Analytics
Data Engineer - ETL, AWS & Analytics

Boardroom Appointments • Johannesburg

On-site
ZAR 700,000 - 1,000,000