Senior AWS Data Engineer — Databricks & Lakehouse Expert

PBT Group

Johannesburg

On-site

ZAR 900,000 - 1,300,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

PBT Group in Johannesburg is seeking an experienced Senior Data Engineer with strong AWS and Databricks expertise to join a data-focused team. You will design, build and optimise scalable data pipelines and platforms that support analytics, reporting and advanced data use cases.

Short-term insurance domain experience is a strong advantage and you will mentor junior engineers while collaborating with data scientists, analysts and stakeholders in an Agile environment.

Qualifications

  • Solid experience as a Senior Data Engineer.
  • Hands-on AWS experience (S3, Glue, Lambda, EMR, Redshift, IAM).
  • Hands-on Databricks experience (Spark, Delta Lake, notebooks, jobs, Unity Catalog).
  • Proficiency in Python and SQL.
  • Experience with data modelling, data quality frameworks and pipeline orchestration.
  • Familiarity with CI/CD, Git and DevOps practices for data solutions.
  • Ability to work in Agile environments with cross-functional teams.
  • Strong problem-solving and communication skills.
  • Advantageous: Short-term insurance or financial services domain experience.
  • Advantageous: Experience with dbt, Airflow, Kafka.

Responsibilities

  • Design, develop and maintain robust, scalable data pipelines using AWS and Databricks.
  • Build and optimise ETL/ELT processes for structured and unstructured data.
  • Implement and manage data lakehouse architectures (including Medallion or similar layered approaches).
  • Ensure data quality, reliability, performance and governance across pipelines.
  • Collaborate with data scientists, analysts, architects and business stakeholders.
  • Contribute to technical design, documentation and best practices.
  • Support production deployments, monitoring and troubleshooting of data solutions.
  • Mentor junior engineers and contribute to continuous improvement of the data platform.

Skills

AWS
Databricks
Python
SQL
Data modelling
Data quality
Pipeline orchestration
CI/CD
Git
DevOps
Agile
Cross-functional teams
Communication skills
Problem solving

Tools

AWS S3
AWS Glue
AWS Lambda
AWS EMR
AWS Redshift
IAM
dbt
Airflow
Kafka
Unity Catalog

Job description

PBT Group in Johannesburg is seeking an experienced Senior Data Engineer with strong AWS and Databricks expertise to join a data-focused team. You will design, build and optimise scalable data pipelines and platforms that support analytics, reporting and advanced data use cases.

Short-term insurance domain experience is a strong advantage and you will mentor junior engineers while collaborating with data scientists, analysts and stakeholders in an Agile environment.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AWS Data Engineer - Databricks & Lakehouse Architect
Senior AWS Data Engineer - Databricks & Lakehouse Architect

PBT Group • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Senior AWS Data Engineer - Databricks & Lakehouse Lead
Senior AWS Data Engineer - Databricks & Lakehouse Lead

JVR Software • Johannesburg

On-site
ZAR 900,000 - 1,400,000
Senior Aws Data Engineer
Senior Aws Data Engineer

PBT Group • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Senior AWS Data Engineer (Contract)
Senior AWS Data Engineer (Contract)

JVR Software • Johannesburg

On-site
ZAR 900,000 - 1,400,000
Senior Aws Data Engineer (Contract)
Senior Aws Data Engineer (Contract)

PBT Group • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Lakehouse Data Engineer | Azure Databricks & AI-ready Data
Lakehouse Data Engineer | Azure Databricks & AI-ready Data

PBT Group • Johannesburg

On-site
ZAR 600,000 - 1,200,000
Databricks & Cloud Data Platform Lead — Cape Town
Databricks & Cloud Data Platform Lead — Cape Town

DVT • Cape Town

On-site
ZAR 900,000 - 1,500,000
Senior Data Engineer - Databricks | Hybrid Parktown
Senior Data Engineer - Databricks | Hybrid Parktown

Sasso Consulting (Pty) Ltd • Johannesburg

Hybrid
ZAR 796,000 - 1,133,000
Databricks Consultant
Databricks Consultant

Sabenza IT & Recruitment • Cape Town

On-site
ZAR 600,000 - 900,000
Senior Data Engineer – Databricks
Senior Data Engineer – Databricks

Sasso Consulting • Johannesburg

Hybrid
ZAR 579,000 - 964,000