Senior AWS Data Engineer - Databricks & Lakehouse Lead

JVR Software

Johannesburg

On-site

ZAR 900,000 - 1,400,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

PBT Group is seeking an experienced Senior Data Engineer to design, build and optimise scalable data pipelines and platforms supporting analytics and reporting. Short-term insurance domain experience is a strong advantage.

Responsibilities include designing robust data pipelines on AWS and Databricks, building ETL/ELT processes, managing data lakehouse architectures, and ensuring data quality and governance across pipelines.

Qualifications

  • Solid experience as a Senior Data Engineer.
  • Strong hands-on experience with AWS (S3, Glue, Lambda, EMR, Redshift, IAM, or equivalent services)
  • Strong hands-on experience with Databricks (including Spark, Delta Lake, notebooks, jobs and Unity Catalog)
  • Proficiency in Python and SQL
  • Experience with data modelling, data quality frameworks and pipeline orchestration
  • Familiarity with CI/CD, Git and DevOps practices for data solutions
  • Ability to work in Agile environments and collaborate effectively with cross-functional teams
  • Strong problem-solving and communication skills

Responsibilities

  • Design, develop and maintain robust, scalable data pipelines using AWS and Databricks
  • Build and optimise ETL/ELT processes for structured and unstructured data
  • Implement and manage data lakehouse architectures (including Medallion or similar layered approaches)
  • Ensure data quality, reliability, performance and governance across pipelines
  • Collaborate with data scientists, analysts, architects and business stakeholders
  • Contribute to technical design, documentation and best practices
  • Support production deployments, monitoring and troubleshooting of data solutions
  • Mentor junior engineers and contribute to continuous improvement of the data platform

Skills

Senior Data Engineer
Python
SQL
Data modelling
Data quality
CI/CD for data
DevOps for data
Agile
Cross-functional collaboration
Problem solving
Communication

Tools

AWS (S3, Glue, Lambda, EMR, Redshift, IAM)
Databricks (Spark, Delta Lake, notebooks, jobs, Unity Catalog)
Git

Job description

PBT Group is seeking an experienced Senior Data Engineer to design, build and optimise scalable data pipelines and platforms supporting analytics and reporting. Short-term insurance domain experience is a strong advantage.

Responsibilities include designing robust data pipelines on AWS and Databricks, building ETL/ELT processes, managing data lakehouse architectures, and ensuring data quality and governance across pipelines.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AWS Data Engineer - Databricks & Lakehouse Architect
Senior AWS Data Engineer - Databricks & Lakehouse Architect

PBT Group • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Senior AWS Data Engineer — Databricks & Lakehouse Expert
Senior AWS Data Engineer — Databricks & Lakehouse Expert

PBT Group • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Senior AWS Data Engineer (Contract)
Senior AWS Data Engineer (Contract)

JVR Software • Johannesburg

On-site
ZAR 900,000 - 1,400,000
Senior Aws Data Engineer (Contract)
Senior Aws Data Engineer (Contract)

PBT Group • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Senior Aws Data Engineer
Senior Aws Data Engineer

PBT Group • Johannesburg

On-site
ZAR 900,000 - 1,300,000
Lakehouse Data Engineer | Azure Databricks & AI-ready Data
Lakehouse Data Engineer | Azure Databricks & AI-ready Data

PBT Group • Johannesburg

On-site
ZAR 600,000 - 1,200,000
Databricks Lakehouse Engineer: Build & Tune Pipelines
Databricks Lakehouse Engineer: Build & Tune Pipelines

Sabenza IT & Recruitment • Eersterivier

On-site
ZAR 900,000 - 1,300,000
Databricks Consultant
Databricks Consultant

Sabenza IT & Recruitment • Eersterivier

On-site
ZAR 900,000 - 1,300,000
Databricks Consultant
Databricks Consultant

Sabenza IT & Recruitment • Cape Town

On-site
ZAR 600,000 - 900,000
Azure Data Engineer: Lakehouse & AI-Ready Data Pipelines
Azure Data Engineer: Lakehouse & AI-Ready Data Pipelines

PBT Group • Johannesburg

Hybrid
ZAR 700,000 - 950,000
Hybrid work arrangement
Johannesburg base