Data Engineer

JMR Software PTY LTD; Wes-Kaap; On-site; ZAR 1,000,000 - 1,500,000; Full time

Job summary

JMR Software PTY LTD is seeking a Senior Data Engineer with a software mindset to design, develop and deploy modern data solutions across cloud and distributed environments. You’ll work on production-grade pipelines, leveraging Spark/PySpark, Databricks, Kafka, and Delta Lake while applying robust software engineering practices.

The role requires strong Python and SQL skills, cloud experience (GCP/AWS/Azure), and proficiency with CI/CD, Docker/Kubernetes, and data platform tooling.

Qualifications

• Strong Python/software engineering fundamentals.
• Cloud data engineering experience across at least one major cloud platform.
• Strong SQL and data modelling skills.
• Experience delivering production data solutions.
• Git, SDLC and CI/CD experience.
• Experience with distributed data processing.
• Cloud-native development experience.
• Problem-solving mindset focused on engineering solutions through code.

Responsibilities

• Design, develop and deploy modern data solutions across cloud environments.
• Involve in building cloud-native data platforms and production-grade data pipelines.
• Work with distributed data processing and streaming technologies.
• Collaborate with cross-functional teams to deliver scalable data solutions.

Skills

Python

SQL

Git

SDLC

CI/CD

REST APIs

Software engineering principles

PySpark

Spark

Databricks

Kafka

Flink

Delta Lake

Data Lake architectures

Distributed data processing

GCP

Azure

AWS

Docker

Kubernetes

Terraform

Monitoring

Tools

BigQuery

Dataflow

Dataproc

Pub/Sub

Cloud Storage

Data Factory

Synapse

Event Hubs

S3

Glue

Redshift

Kinesis

EMR

Job description

Senior Data Engineer | Modern Cloud & Data Engineering

We’re looking for a modern Data Engineer who thinks like a software engineer.

This isn’t a traditional SQL/ETL-focused Data Engineering role. The ideal candidate will have strong software engineering fundamentals and hands‑on experience building cloud‑native data platforms and production‑grade data solutions.

What You’ll Be Working With

You’ll be involved in designing, developing and deploying modern data solutions across cloud and distributed data environments.

Core Engineering

• Strong Python development skills
• Strong SQL capability
• Git and collaborative version control
• Software engineering principles and clean coding practices
• SDLC experience
• CI/CD and automated deployment pipelines
• REST APIs

Modern Data Engineering

• Apache Spark / PySpark
• Databricks
• Kafka / streaming technologies
• Flink
• Delta Lake
• Data Lake architectures
• Modern ELT and distributed data processing

Cloud

Hands‑on experience with at least one major cloud platform:

• Google Cloud Platform (GCP)
• Microsoft Azure
• Amazon Web Services (AWS)

Experience with technologies such as Dataflow, BigQuery, Dataproc, Pub/Sub, Cloud Storage, Data Factory, Synapse, Event Hubs, S3, Glue, Redshift, Kinesis or EMR would be highly advantageous.

DevOps & Infrastructure

• Docker
• Kubernetes
• Terraform / Infrastructure as Code
• Monitoring and observability
• Production deployment experience

What We’re Looking For

The strongest candidates will bring a combination of:

• Strong Python/software engineering fundamentals
• Modern cloud data engineering experience
• Strong SQL and data modelling skills
• Experience delivering production solutions
• Git, SDLC and CI/CD experience
• Experience with distributed data processing
• Cloud‑native development experience
• A problem‑solving mindset focused on engineering solutions through code

What This Role Is NOT

This is not primarily a traditional SQL/SSIS/ETL role.

Candidates whose experience is limited to:

• SQL and stored procedures
• SSIS
• Traditional ETL
• Data warehouse development without strong Python, cloud, software engineering and modern data platform experience are unlikely to be suitable.

Why Join?

You’ll work on modern data engineering projects, helping clients build scalable, cloud‑native platforms while working alongside experienced technology professionals.

If you’re a Data Engineer with a Software Engineering mindset and enjoy building modern data platforms rather than simply moving data between databases, we’d love to hear from you.