Senior AWS Data Engineer: Pipelines, Glue & Spark

Amidel; Johannesburg; On-site; ZAR 900,000 - 1,300,000; Full time

Job summary

Amidel is seeking an Intermediate/Senior AWS Data Engineer to design and build data pipelines on AWS using Glue PySpark. The role requires a strong Python or C# background, 5+ years development and 3+ years AWS data engineering, plus AWS Data Engineer – Associate certification.

You will ingest data into S3, perform ETL into RDS/Redshift, and apply best practices in security, backup, and scalable architecture. A Bachelor's in CS/IS is required; ML Specialty is advantageous.

Qualifications

• Minimum 5 years Python/C# development.
• Minimum 3 years AWS data engineering experience.
• AWS Certified Data Engineer – Associate is required.
• Bachelor's degree in CS/IS or related field.
• Advantageous: AWS Certified Machine Learning – Specialty.

Responsibilities

• Create data models to extract and store data from multiple sources.
• Lead design and delivery of large-scale data solutions on AWS.
• Utilise SQL and ETL processes for data integration.
• Ingest data into AWS S3 and ETL into RDS or Redshift.
• Use AWS Lambda (Python or C#) for event-driven data transformations.
• Ensure data security and implement backup/recovery procedures.
• Automate migration of data pipelines from development to production.
• Deliver timely, actionable data content to support business decisions.
• Contribute to data architecture, pipeline design, and production deployment.
• Work with batch, streaming, and hybrid architectures across cloud and on‑premise.

Skills

AWS Glue PySpark

Python

C#

SQL

ETL

Data modeling

AWS Lambda

Kafka

Redshift

S3

Education

Bachelor's degree in Computer Science, Information Systems, or related field

AWS Certified Data Engineer – Associate

AWS Certified Machine Learning – Specialty

Tools

PostgreSQL

MySQL

SQL Server

Job description

Amidel is seeking an Intermediate/Senior AWS Data Engineer to design and build data pipelines on AWS using Glue PySpark. The role requires a strong Python or C# background, 5+ years development and 3+ years AWS data engineering, plus AWS Data Engineer – Associate certification.

You will ingest data into S3, perform ETL into RDS/Redshift, and apply best practices in security, backup, and scalable architecture. A Bachelor's in CS/IS is required; ML Specialty is advantageous.