Senior Data Engineer (Spark/Python) - Remote SA with ESOP

WatersEdge Solutions; Cape Town; Remote; ZAR 1,000,000 - 1,400,000; Full time

Benefits offered by this job

Flexible working arrangements

Wellness support and home office reimbursement

Continuous learning opportunities

Competitive salary and recognition for performance

Job summary

A leading data engineering company is seeking a Senior Data Engineer (Spark & Python Specialist) to work remotely in South Africa. The role involves building scalable data solutions and optimising Spark-based processing. Candidates should have 6+ years of experience in Spark/PySpark and strong skills in Python and T-SQL. Enjoy flexible working arrangements and a competitive salary with a supportive team culture focused on accountability and work-life balance.

Qualifications

• 6+ years of Spark / PySpark experience.
• Strong production-grade Python capability.
• Solid T-SQL skills with experience interpreting existing SQL logic.

Responsibilities

• Optimise Spark-based processing through best practices.
• Build and maintain data pipelines using Python, PySpark, and Delta Lake.
• Refactor legacy SQL-based ETL logic into clean Python libraries.

Skills

Spark

Python

PySpark

Delta Lake

T-SQL

Docker

Airflow

Education

Bachelor’s degree in Computer Science or related field

Tools

Azure Synapse Analytics

Data Factory

Job description

A leading data engineering company is seeking a Senior Data Engineer (Spark & Python Specialist) to work remotely in South Africa. The role involves building scalable data solutions and optimising Spark-based processing. Candidates should have 6+ years of experience in Spark/PySpark and strong skills in Python and T-SQL. Enjoy flexible working arrangements and a competitive salary with a supportive team culture focused on accountability and work-life balance.