Senior Data Analyst: Spark, Databricks, Python in Finance/Insurance

Savageone Pty Ltd; Gauteng; On-site; ZAR 300 000 - 400 000; Full time

Job summary

A leading firm in insurance and finance in South Africa is seeking an experienced Data Analyst to join their team. The ideal candidate will have over 8 years of experience and strong proficiency in SQL, Spark, and Python. Responsibilities include collecting and analyzing data, developing ETL processes, and working with AWS for cloud-based data management. This position offers a competitive salary and an immediate start.

Qualifications

• 8+ years of experience in data analysis or a similar role.
• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.

Responsibilities

• Collect and analyze large datasets from multiple sources.
• Develop and maintain ETL processes.
• Utilize Databricks and the Spark Framework for data processing.
• Write and optimize SQL queries.
• Create and manage scripts for data manipulation and analysis.
• Develop data visualizations and reports using Power BI.
• Work with AWS to manage and analyze cloud-based data.
• Utilize Python for data analysis and automation tasks.
• Apply SAS for advanced analytics and statistical modeling.
• Collaborate with cross-functional teams to understand business needs.

Skills

SQL

Spark

Git

Python

Machine learning libraries (e.g., scikit-learn)

Power BI

Qlik

AWS

SAS

Education

Bachelor’s degree in Computer Science, Data Science, Statistics, or a related field

Tools

Databricks

Job description

A leading firm in insurance and finance in South Africa is seeking an experienced Data Analyst to join their team. The ideal candidate will have over 8 years of experience and strong proficiency in SQL, Spark, and Python. Responsibilities include collecting and analyzing data, developing ETL processes, and working with AWS for cloud-based data management. This position offers a competitive salary and an immediate start.