Data Engineer: Pipelines & ML (AWS/Databricks)

PBT Group; Johannesburg; On-site; ZAR 600 000 - 800 000; Full time

Job summary

A technology services company is seeking a skilled Data Engineer to design and optimize data pipelines supporting advanced analytics. The role involves collaboration with data teams to ensure data quality and integration into AWS and Databricks environments. Candidates should have over 4 years of experience, strong AWS and Python skills, and familiarity with data orchestration tools. A degree in a related field is preferred.

Qualifications

• 4+ years’ experience as a Data Engineer, preferably in financial services or insurance.
• Advanced proficiency in Python for ETL/ELT development and automation.
• Familiarity with AWS services.

Responsibilities

• Design, build, and maintain robust data pipelines.
• Integrate data from multiple source systems into AWS and Databricks environments.
• Implement data quality and validation frameworks.

Skills

Data pipeline design and maintenance

Collaboration with data scientists and analysts

AWS (Lambda, S3, Glue, Redshift, EMR)

Python for ETL/ELT development

SQL and data modelling

Data orchestration tools (e.g., Airflow)

Agile methodologies

Education

Degree in Computer Science or related field

Tools

Databricks

Salesforce

TIA

Job description

A technology services company is seeking a skilled Data Engineer to design and optimize data pipelines supporting advanced analytics. The role involves collaboration with data teams to ensure data quality and integration into AWS and Databricks environments. Candidates should have over 4 years of experience, strong AWS and Python skills, and familiarity with data orchestration tools. A degree in a related field is preferred.