Data Engineer: Build Scalable Pipelines on Databricks

LexisNexis; Cape Town; On-site; ZAR 200 000 - 300 000; Full time

Job summary

A leading legal analytics provider in Cape Town is seeking a Data Engineer to contribute to their Strategic Data Platform. In this early-career role, you will develop and maintain robust data pipelines using Python and Databricks, collaborating with senior engineers and cross-functional teams. The ideal candidate should have experience in software engineering, strong problem-solving skills, and a keen interest in data delivery patterns. The role promises professional growth in a supportive work environment.

Benefits

Medical Aid

Retirement Plan with Risk Benefits

Study Leave

Flexible Working Hours

Qualifications

• Hands-on experience in a software/data engineering role.
• Proficient in Python and working knowledge of PySpark or similar.
• Experience with SQL and structured data manipulation.

Responsibilities

• Develop and maintain data pipelines using Python and PySpark.
• Support delivery of datasets via Databricks and RESTful APIs.
• Collaborate with cross-functional teams including analysts and product managers.

Skills

Python

PySpark

SQL

REST APIs

Git

Problem-solving mindset

Communication skills

Tools

Databricks

Job description

A leading legal analytics provider in Cape Town is seeking a Data Engineer to contribute to their Strategic Data Platform. In this early-career role, you will develop and maintain robust data pipelines using Python and Databricks, collaborating with senior engineers and cross-functional teams. The ideal candidate should have experience in software engineering, strong problem-solving skills, and a keen interest in data delivery patterns. The role promises professional growth in a supportive work environment.