Cloud Data Engineer: PySpark, Python & AWS Pipelines

Boardroom Appointments; Cape Town; On-site; ZAR 500,000 - 700,000; Full time

Job summary

A recruitment agency is looking for a Software Developer/Data Engineer for a 12-month contract in Cape Town. The successful candidate will have 4 to 8 years of experience working on data-driven ecosystems, expertise in AWS services, and strong skills in PySpark, Python, and SQL. Responsibilities include building data pipelines and mentoring junior developers. If you have a solid understanding of data architecture and are adept at implementing automation practices, we encourage you to apply.

Qualifications

• Minimum 4 years of experience in Data Engineering or Software Development.
• Experience with cloud technologies, particularly AWS.
• Proficiency in coding languages: PySpark, Python, SQL.

Responsibilities

• Implement scalable data pipelines and architectures.
• Build distributed data systems using AWS Lambda and Glue.
• Collaborate with team to meet business requirements.

Skills

Data Engineering

Software Development

Data Modeling

AWS Lambda

PySpark

Python

SQL

Education

BSc Computer Science

BEng

AWS Professional Certification

Tools

AWS S3

AWS Athena

AWS Glue

AWS EC2

JIRA

Confluence

GIT

Job description

A recruitment agency is looking for a Software Developer/Data Engineer for a 12-month contract in Cape Town. The successful candidate will have 4 to 8 years of experience working on data-driven ecosystems, expertise in AWS services, and strong skills in PySpark, Python, and SQL. Responsibilities include building data pipelines and mentoring junior developers. If you have a solid understanding of data architecture and are adept at implementing automation practices, we encourage you to apply.