Senior Data Platform Engineer – Lakehouse & Cloud

Blue Pearl PTY; Johannesburg; On-site; ZAR 800,000 - 1,200,000; Full time

Benefits offered by this job

None

Job summary

Blue Pearl PTY in Johannesburg is seeking a data engineer to design and build scalable data platforms using cloud-native and lakehouse architectures. You will develop data pipelines with Python, SQL, and tools such as Databricks, dbt, and Git.

You will lead end-to-end data platform delivery, mentor junior consultants, and collaborate with stakeholders to align data solutions with business strategy while practising CI/CD and IaC.

Qualifications

• 3–5 years of hands-on data engineering experience.
• Strong Python and SQL skills with query optimisation.
• Experience with relational and non-relational databases.
• Designing/building data pipelines and data models.
• Practical knowledge of lakehouse architectures and medallion pattern.
• Experience on AWS, Azure, Google Cloud or similar cloud platforms.
• Knowledge of Databricks, Snowflake, and dbt.
• Version control and CI/CD for data workflows.

Responsibilities

• Design and build scalable data platforms and pipelines.
• Engage with stakeholders to align data solutions with business strategy.
• Mentor junior and intermediate consultants.
• Lead end-to-end data platform delivery and architecture.
• Support pre-sales activities and technical proposals.
• Identify automation opportunities and optimise data delivery.
• Contribute to technical strategy and knowledge sharing.

Skills

Python

SQL

Data pipelines

Query optimisation

Cloud platforms

Git

Databricks

dbt

Spark (PySpark)

Leadership

Education

Bachelor's degree in Computer Science

Bachelor's degree in Information Systems

Bachelor's degree in Information Technology

Master's degree advantageous

Tools

Databricks

Snowflake

Terraform

AWS CDK

Pulumi

Microsoft Fabric

Azure Synapse

Google BigQuery

Git

Job description

Blue Pearl PTY in Johannesburg is seeking a data engineer to design and build scalable data platforms using cloud-native and lakehouse architectures. You will develop data pipelines with Python, SQL, and tools such as Databricks, dbt, and Git.

You will lead end-to-end data platform delivery, mentor junior consultants, and collaborate with stakeholders to align data solutions with business strategy while practising CI/CD and IaC.