Data Engineer

Network IT; Durban; On-site; ZAR 600,000 - 900,000; Full time

Job summary

An innovative FinTech firm is seeking a Data Engineer to develop scalable data infrastructure and streamline data processes. Join a tech-forward team focused on data quality governance and automation using a modern stack including Python, AWS, and Terraform.

Qualifications

• BSc in Computer Science, Engineering, Information Systems or equivalent.
• 5 years of experience in data engineering.
• Hands-on experience with AWS and data services.

Responsibilities

• Design and implement scalable automated data pipelines.
• Optimize data delivery and transformation processes.
• Ensure data security and enforce governance best practices.

Skills

Python

SQL

AWS

Airflow

Terraform

PySpark

Data Lifecycle

Data Governance

CI/CD

Education

BSc in Computer Science

BSc in Engineering

BSc in Information Systems

Tools

AWS Glue

Docker

Apache Hive

Apache Pig

NoSQL

Kafka

Job description

Build Scalable Data Infrastructure as a Data Engineer.

Duties & Responsibilities

FinTech

Python AWS & PySpark Experience a Must

An innovative FinTech firm is hiring a Data Engineer to drive data infrastructure initiatives and streamline data processes. If you thrive in a fastpaced cloudfirst environment and enjoy designing efficient data systems from scratch this is your chance to make a real impact.

Youll join a techforward team where data quality governance and automation are key. Expect to work with a modern stack Python AWS Airflow and Terraform on systems that power realtime analytics and decisionmaking.

Qualifications :

• BSc in Computer Science Engineering Information Systems or equivalent
• 5 years in data engineering
• 2 years experience building and optimizing big data pipelines and architecture

Requirements :

• Proficient in Python and SQL (PostgreSQL and MSSQL)
• Handson experience with AWS and data services like Glue
• Skilled in Airflow Docker Terraform and PySpark
• Strong CI / CD and GitHub version control practices
• Knowledge of data lifecycle quality assurance and governance
• Solid understanding of scalable data stores and stream processing
• Excellent troubleshooting and problemsolving skills

Key Performance Areas (KPAs) :

• Design and implement scalable automated data pipelines
• Optimize data delivery storage and transformation processes
• Develop monitoring testing and CI / CD workflows for data systems
• Maintain data lakes warehouses and metadata / catalogue systems
• Support analytics / reporting infrastructure and ensure data integrity
• Lead internal process improvements and data system enhancements
• Ensure data security and enforce governance best practices

Apply now!

If youre a passionate Data Engineer looking to join a modern FinTech team that values innovation clean architecture and performancedont miss out!

For more IT jobs please visit you have not had any response in two weeks please consider the vacancy application unsuccessful. Your profile will be kept on our database for any other suitable roles / positions.

For more information contact :

Key Skills

Apache Hive,S3,Hadoop,Redshift,Spark,AWS,Apache Pig,NoSQL,Big Data,Data Warehouse,Kafka,Scala

Employment Type : Full-Time

Experience : years

Vacancy : 1

Create a job alert for this search

Data Engineer • Durban, KwaZulu-Natal, South Africa