Senior Aws Data Engineer

PBT Group

Johannesburg

Sur place

ZAR 900 000 - 1 300 000

Plein temps

Il y a 7 jours
Soyez parmi les premiers à postuler

Obtenez une réponse de cet employeur

Votre CV et votre lettre de motivation, adaptés exactement à ce que l’employeur recherche.

Passez les filtres ATS

Résumé du poste

PBT Group in Johannesburg is seeking an experienced Senior Data Engineer with strong AWS and Databricks expertise to join a data-focused team. You will design, build and optimise scalable data pipelines and platforms that support analytics, reporting and advanced data use cases.

Short-term insurance domain experience is a strong advantage and you will mentor junior engineers while collaborating with data scientists, analysts and stakeholders in an Agile environment.

Qualifications

  • Solid experience as a Senior Data Engineer.
  • Hands-on AWS experience (S3, Glue, Lambda, EMR, Redshift, IAM).
  • Hands-on Databricks experience (Spark, Delta Lake, notebooks, jobs, Unity Catalog).
  • Proficiency in Python and SQL.
  • Experience with data modelling, data quality frameworks and pipeline orchestration.
  • Familiarity with CI/CD, Git and DevOps practices for data solutions.
  • Ability to work in Agile environments with cross-functional teams.
  • Strong problem-solving and communication skills.
  • Advantageous: Short-term insurance or financial services domain experience.
  • Advantageous: Experience with dbt, Airflow, Kafka.

Responsabilités

  • Design, develop and maintain robust, scalable data pipelines using AWS and Databricks.
  • Build and optimise ETL/ELT processes for structured and unstructured data.
  • Implement and manage data lakehouse architectures (including Medallion or similar layered approaches).
  • Ensure data quality, reliability, performance and governance across pipelines.
  • Collaborate with data scientists, analysts, architects and business stakeholders.
  • Contribute to technical design, documentation and best practices.
  • Support production deployments, monitoring and troubleshooting of data solutions.
  • Mentor junior engineers and contribute to continuous improvement of the data platform.

Connaissances

AWS
Databricks
Python
SQL
Data modelling
Data quality
Pipeline orchestration
CI/CD
Git
DevOps
Agile
Cross-functional teams
Communication skills
Problem solving

Outils

AWS S3
AWS Glue
AWS Lambda
AWS EMR
AWS Redshift
IAM
dbt
Airflow
Kafka
Unity Catalog

Description du poste

Senior AWS Data Engineer job vacancy in Johannesburg.

PBT Group is seeking an experienced Senior Data Engineer with strong AWS and Databricks expertise to join a data-focused team.

The successful candidate will design, build and optimise scalable data pipelines and platforms that support analytics, reporting and advanced data use cases.

Short-term insurance domain experience is a strong advantage.

Key Responsibilities:

  • Design, develop and maintain robust, scalable data pipelines using AWS and Databricks.
  • Build and optimise ETL/ELT processes for structured and unstructured data.
  • Implement and manage data lakehouse architectures (including Medallion or similar layered approaches).
  • Ensure data quality, reliability, performance and governance across pipelines.
  • Collaborate with data scientists, analysts, architects and business stakeholders.
  • Contribute to technical design, documentation and best practices.
  • Support production deployments, monitoring and troubleshooting of data solutions.
  • Mentor junior engineers and contribute to continuous improvement of the data platform.

Minimum Requirements:

  • Solid experience as a Senior Data Engineer.
  • Strong hands-on experience with AWS (S3, Glue, Lambda, EMR, Redshift, IAM, or equivalent services).
  • Strong hands-on experience with Databricks (including Spark, Delta Lake, notebooks, jobs and Unity Catalog).
  • Proficiency in Python and SQL.
  • Experience with data modelling, data quality frameworks and pipeline orchestration.
  • Familiarity with CI/CD, Git and DevOps practices for data solutions.
  • Ability to work in Agile environments and collaborate effectively with cross-functional teams.
  • Strong problem-solving and communication skills.
  • Advantageous.
    • Short-term insurance or financial services domain experience.
    • Experience with other cloud platforms or modern data tools (e.g. dbt, Airflow, Kafka).
    • Knowledge of data governance, security and cost optimisation on AWS.
    • Databricks certifications.
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Senior Aws Data Engineer (Contract)
Senior Aws Data Engineer (Contract)

PBT Group • Johannesburg

Sur place
ZAR 900 000 - 1 300 000
Senior AWS Data Engineer (Contract)
Senior AWS Data Engineer (Contract)

JVR Software • Johannesburg

Sur place
ZAR 900 000 - 1 400 000
Senior AWS Data Engineer — Databricks & Lakehouse Expert
Senior AWS Data Engineer — Databricks & Lakehouse Expert

PBT Group • Johannesburg

Sur place
ZAR 900 000 - 1 300 000
Senior AWS Data Engineer - Databricks & Lakehouse Lead
Senior AWS Data Engineer - Databricks & Lakehouse Lead

JVR Software • Johannesburg

Sur place
ZAR 900 000 - 1 400 000
Senior AWS Data Engineer - Databricks & Lakehouse Architect
Senior AWS Data Engineer - Databricks & Lakehouse Architect

PBT Group • Johannesburg

Sur place
ZAR 900 000 - 1 300 000
Senior Data Engineer — Azure Data Platform & Analytics
Senior Data Engineer — Azure Data Platform & Analytics

Cf Consulting • Gauteng

Sur place
ZAR 700 000 - 1 000 000
Competitive salary
On-site work environment
Medical, dental, and vision insurance
+2
Data Engineer – Banking (Cib)
Data Engineer – Banking (Cib)

Blue Pearl Pty Ltd • Johannesburg

Hybride
ZAR 950 000 - 1 350 000
Hybrid work arrangement
Senior AWS Cloud Data Analyst
Senior AWS Cloud Data Analyst

Impronics Digitech • Johannesburg

Sur place
ZAR 600 000 - 800 000
Opportunity to work on cutting-edge projects
Clear path to permanent employment
Competitive compensation
+1
Senior Data Engineer – Databricks
Senior Data Engineer – Databricks

Sasso Consulting • Johannesburg

Hybride
ZAR 579 000 - 964 000
Data Engineer
Data Engineer

Parvana • Kraaifontein

Hybride
ZAR 650 000 - 900 000