Data Platform Engineer: Lakehouse & Cloud Pipelines

Blue Pearl PTY LTD; Johannesburg; On-site; ZAR 600,000 - 1,200,000; Full time

Job summary

Blue Pearl PTY LTD in Johannesburg seeks a Data Engineer to design and build scalable data platforms using cloud-native and lakehouse architectures. You will develop data pipelines with Python, SQL, dbt, and tools like Databricks, ADF, AWS Glue, and BigQuery, while modernising legacy environments and migrating to the cloud.

You will engage with clients to shape data solutions, support pre-sales, and mentor junior engineers, balancing billable work with team growth and knowledge sharing.

Qualifications

• 3–5 years of hands-on experience in data engineering.
• Strong proficiency in Python and/or SQL, including query optimisation.
• Experience designing and building data pipelines and data models.
• Experience with lakehouse architectures and medallion pattern.
• Practical experience with major cloud platforms: Azure, AWS, GCP.
• Familiarity with Databricks, Snowflake, Delta Lake, PySpark.
• Understanding of dbt for data transformations.
• Experience with Git and CI/CD for data workflows.
• Strong analytical and problem-solving skills; stakeholder engagement.

Responsibilities

• Design and build scalable data platforms using cloud-native and Lakehouse architectures.
• Develop and optimise data pipelines using Python, SQL, and tools like Azure Data Factory, AWS Glue, Google Dataflow, Databricks, and dbt.
• Modernise legacy data environments by migrating to cloud-native platforms (Azure, AWS, GCP, Fabric, Synapse, BigQuery, Databricks).
• Engage with clients to conceptualise data solutions aligned to business strategy.
• Support pre-sales activities, proofs-of-concept, and technical proposals.
• Mentor junior/intermediate consultants and lead technical reviews.

Skills

Python

SQL

PySpark

dbt

Lakehouse

Git

CI/CD

Data modeling

Cloud platforms

Education

Bachelor's degree in Computer Science / Information Systems / Information Technology

Master's degree advantageous

Tools

Databricks

Snowflake

Delta Lake

Azure Data Factory

AWS Glue

BigQuery

Terraform

Job description

Blue Pearl PTY LTD in Johannesburg seeks a Data Engineer to design and build scalable data platforms using cloud-native and lakehouse architectures. You will develop data pipelines with Python, SQL, dbt, and tools like Databricks, ADF, AWS Glue, and BigQuery, while modernising legacy environments and migrating to the cloud.

You will engage with clients to shape data solutions, support pre-sales, and mentor junior engineers, balancing billable work with team growth and knowledge sharing.