Data Engineer: Architect Scalable Pipelines & Insights

Pepkor Lifestyle; Johannesburg; On-site; ZAR 600,000 - 1,000,000; Full time

Job summary

Pepkor Lifestyle is seeking a Data Engineer who will leverage big data analytics to provide actionable insights across the business. You will design, develop, and maintain data pipelines, data warehouses, and storage solutions, ensuring data quality, availability, and reliability for analysts and decision makers.

You will collaborate with data scientists and stakeholders, optimize ETL processes, and stay current with emerging technologies while upholding data governance standards.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer in a professional setting.
• Proficiency in SQL, Python, Scala, and Java.
• Strong knowledge of data storage, database design, and data modelling concepts.
• Experience with ETL tools, data integration, and data pipeline orchestration.
• Familiarity with Snowflake and Redshift data warehouses.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills.
• 5-10 years’ experience in designing and developing data warehouses using Kimball methodology.
• Experience with ingesting/outputting CSV, JSON, and other flat files.
• AWS Certified Data Analytics or equivalent certifications.

Responsibilities

• Collaborate with data scientists, analysts, and stakeholders to understand data requirements.
• Design, develop, and maintain data pipelines and ETL processes.
• Implement and maintain data warehousing and data storage solutions.
• Optimize data pipelines for performance, scalability, and reliability.
• Ensure data quality and integrity through data validation and cleansing.
• Monitor and troubleshoot data infrastructure issues.
• Stay current with emerging data engineering technologies and best practices.
• Systematic design of ETL and data pipelines aligned to business specifications.
• Develop and implement ETL pipelines aligned to the approved solution design.
• Ensure data governance and data quality assurance standards are upheld.
• Deal with customers in a customer-centric manner.
• Effective self-management and teamwork.

Skills

SQL

Python

Scala

Java

Data modelling

ETL

Data warehousing

Snowflake

Redshift

AWS

Data governance

Data quality

Communication

Team collaboration

Education

Bachelor's degree in Computer Science, Information Technology, or a related field

Tools

Snowflake

Amazon Redshift

SAS Data Studio

AWS

ETL tools

Data pipeline orchestration

SQL databases

Job description

Pepkor Lifestyle is seeking a Data Engineer who will leverage big data analytics to provide actionable insights across the business. You will design, develop, and maintain data pipelines, data warehouses, and storage solutions, ensuring data quality, availability, and reliability for analysts and decision makers.

You will collaborate with data scientists and stakeholders, optimize ETL processes, and stay current with emerging technologies while upholding data governance standards.