Senior AWS Data Engineer (Contract)

JVR Software

Johannesburg

Sur place

ZAR 900 000 - 1 400 000

Plein temps

Il y a 5 jours
Soyez parmi les premiers à postuler

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

PBT Group is seeking an experienced Senior Data Engineer to design, build and optimise scalable data pipelines and platforms supporting analytics and reporting. Short-term insurance domain experience is a strong advantage.

Responsibilities include designing robust data pipelines on AWS and Databricks, building ETL/ELT processes, managing data lakehouse architectures, and ensuring data quality and governance across pipelines.

Qualifications

  • Solid experience as a Senior Data Engineer.
  • Strong hands-on experience with AWS (S3, Glue, Lambda, EMR, Redshift, IAM, or equivalent services)
  • Strong hands-on experience with Databricks (including Spark, Delta Lake, notebooks, jobs and Unity Catalog)
  • Proficiency in Python and SQL
  • Experience with data modelling, data quality frameworks and pipeline orchestration
  • Familiarity with CI/CD, Git and DevOps practices for data solutions
  • Ability to work in Agile environments and collaborate effectively with cross-functional teams
  • Strong problem-solving and communication skills

Responsabilités

  • Design, develop and maintain robust, scalable data pipelines using AWS and Databricks
  • Build and optimise ETL/ELT processes for structured and unstructured data
  • Implement and manage data lakehouse architectures (including Medallion or similar layered approaches)
  • Ensure data quality, reliability, performance and governance across pipelines
  • Collaborate with data scientists, analysts, architects and business stakeholders
  • Contribute to technical design, documentation and best practices
  • Support production deployments, monitoring and troubleshooting of data solutions
  • Mentor junior engineers and contribute to continuous improvement of the data platform

Connaissances

Senior Data Engineer
Python
SQL
Data modelling
Data quality
CI/CD for data
DevOps for data
Agile
Cross-functional collaboration
Problem solving
Communication

Outils

AWS (S3, Glue, Lambda, EMR, Redshift, IAM)
Databricks (Spark, Delta Lake, notebooks, jobs, Unity Catalog)
Git

Description du poste

PBT Group is seeking an experienced Senior Data Engineer with strong AWS and Databricks expertise to join a data-focused team. The successful candidate will design, build and optimise scalable data pipelines and platforms that support analytics, reporting and advanced data use cases.

Short-term insurance domain experience is a strong advantage.

Key Responsibilities
  • Design, develop and maintain robust, scalable data pipelines using AWS and Databricks

  • Build and optimise ETL/ELT processes for structured and unstructured data

  • Implement and manage data lakehouse architectures (including Medallion or similar layered approaches)

  • Ensure data quality, reliability, performance and governance across pipelines

  • Collaborate with data scientists, analysts, architects and business stakeholders

  • Contribute to technical design, documentation and best practices

  • Support production deployments, monitoring and troubleshooting of data solutions

  • Mentor junior engineers and contribute to continuous improvement of the data platform

Required Skills & Experience
  • Solid experience as a Senior Data Engineer

  • Strong hands-on experience with AWS (S3, Glue, Lambda, EMR, Redshift, IAM, or equivalent services)

  • Strong hands-on experience with Databricks (including Spark, Delta Lake, notebooks, jobs and Unity Catalog)

  • Proficiency in Python and SQL

  • Experience with data modelling, data quality frameworks and pipeline orchestration

  • Familiarity with CI/CD, Git and DevOps practices for data solutions

  • Ability to work in Agile environments and collaborate effectively with cross-functional teams

  • Strong problem-solving and communication skills

Advantageous
  • Short-term insurance or financial services domain experience

  • Experience with other cloud platforms or modern data tools (e.g. dbt, Airflow, Kafka)

  • Knowledge of data governance, security and cost optimisation on AWS

  • Databricks certifications

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior Aws Data Engineer (Contract)
Senior Aws Data Engineer (Contract)

PBT Group • Johannesburg

Sur place
ZAR 900 000 - 1 300 000
Senior Aws Data Engineer
Senior Aws Data Engineer

PBT Group • Johannesburg

Sur place
ZAR 900 000 - 1 300 000
Senior AWS Data Engineer - Databricks & Lakehouse Lead
Senior AWS Data Engineer - Databricks & Lakehouse Lead

JVR Software • Johannesburg

Sur place
ZAR 900 000 - 1 400 000
Senior AWS Data Engineer - Databricks & Lakehouse Architect
Senior AWS Data Engineer - Databricks & Lakehouse Architect

PBT Group • Johannesburg

Sur place
ZAR 900 000 - 1 300 000
Senior AWS Data Engineer — Databricks & Lakehouse Expert
Senior AWS Data Engineer — Databricks & Lakehouse Expert

PBT Group • Johannesburg

Sur place
ZAR 900 000 - 1 300 000
Data Engineer
Data Engineer

PBT Group • Johannesburg

Sur place
ZAR 600 000 - 1 200 000
Senior Data Engineer
Senior Data Engineer

Indsafri • Afrique du Sud

Sur place
ZAR 900 000 - 1 500 000
Senior Data Engineer- AWS
Senior Data Engineer- AWS

Impronics Technologies • Gauteng

Sur place
ZAR 600 000 - 800 000
Cloud Data Engineer: PySpark, Python & AWS Pipelines
Cloud Data Engineer: PySpark, Python & AWS Pipelines

Boardroom Appointments • Cape Town

Sur place
ZAR 500 000 - 700 000
Senior Data Engineer- AWS
Senior Data Engineer- AWS

Impronics Digitech • Johannesburg

Sur place
ZAR 600 000 - 800 000