Data Engineer - Build Scalable Pipelines & Insights

Firstrand Bank Limited; Johannesburg; On-site; ZAR 700,000 - 1,200,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Performance bonuses

Professional development opportunities

Ample paid time off

Retirement savings plan

Job summary

Firstrand Bank Limited in Randburg, Gauteng, seeks an experienced AI/ML Data Engineer to build and maintain robust data pipelines and infrastructure for analytics initiatives.

You will collect, clean, transform, and manage large datasets to ensure readiness for data scientists and ML engineers, emphasizing data quality and efficient storage. This role offers growth in a forward-thinking financial institution.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 3+ years of experience in data engineering, supporting AI/ML workloads.
• Proficiency in SQL with relational and NoSQL databases.
• Experience with ETL tools and frameworks (Spark, Pandas, Airflow).
• Python or Scala programming experience.
• Familiar with cloud data platforms (AWS, Azure, GCP).
• Understanding of data warehousing and big data concepts.
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork abilities.
• Data modeling experience is a plus.

Responsibilities

• Design, build, and maintain scalable data pipelines for AI/ML projects.
• Develop and implement ETL processes to extract, transform, and load data from multiple sources.
• Ensure data quality, integrity, and consistency across data systems.
• Collaborate with data scientists and ML engineers to understand data requirements.
• Optimize data storage and retrieval for performance and efficiency.
• Manage and maintain databases and data warehouses.
• Implement data governance and security best practices.
• Develop tools and scripts to automate data-related tasks.
• Monitor data pipeline performance and troubleshoot issues.
• Stay current with emerging data engineering technologies and best practices.

Skills

SQL

Python

Scala

ETL

Cloud platforms

Data modeling

Data warehousing

Big data

Teamwork

Problem-solving

Education

Bachelor's degree in Computer Science/Information Technology/Engineering

Tools

Apache Spark

Pandas

Airflow

Job description

About the Role Our client is a data-driven organization that leverages Artificial Intelligence to solve complex business challenges. We are seeking an experienced AI/ML Data Engineer to join our talented team in Randburg, Gauteng. This role is critical for building and maintaining the robust data pipelines and infrastructure necessary to support our machine learning initiatives. You will be responsible for collecting, cleaning, transforming, and managing large datasets to ensure they are readily available and optimally formatted for our data scientists and ML engineers. Our client is committed to fostering a collaborative and innovative environment where data is at the heart of decision-making. You will work with cutting-edge technologies and contribute to projects that have a significant impact across the business. The ideal candidate is passionate about data quality, efficiency, and possesses strong skills in data manipulation, ETL processes, and database management. We value individuals who are proactive, detail-oriented, and eager to contribute to the success of our AI and analytics endeavors. This position provides an excellent opportunity to grow your career in a dynamic and forward-thinking company.

Key Responsibilities

• Design, build, and maintain scalable data pipelines for AI and machine learning projects.
• Develop and implement ETL processes to extract, transform, and load data from various sources.
• Ensure data quality, integrity, and consistency across all data systems.
• Collaborate with data scientists and ML engineers to understand their data requirements.
• Optimize data storage and retrieval for performance and efficiency.
• Manage and maintain databases and data warehouses.
• Implement data governance and security best practices.
• Develop tools and scripts to automate data-related tasks.
• Monitor data pipeline performance and troubleshoot issues.
• Stay current with emerging data engineering technologies and best practices.

Requirements

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 3+ years of experience in data engineering, with a focus on supporting AI/ML workloads.
• Proficiency in SQL and experience with relational and NoSQL databases.
• Strong experience with ETL tools and frameworks (e.g., Apache Spark, Pandas, Airflow).
• Experience in programming languages such as Python or Scala.
• Familiarity with cloud data platforms (AWS, Azure, GCP).
• Understanding of data warehousing concepts and big data technologies.
• Excellent problem-solving and analytical skills.
• Strong communication and teamwork abilities.
• Experience with data modeling is a plus.

Benefits

• Competitive salary and comprehensive benefits package including medical, dental, and vision insurance.
• Performance bonuses awarded based on individual and company success.
• Opportunities for professional development including training and workshops.
• Ample paid time off.
• Retirement savings plan with company contributions.