AI Data Engineer - Scalable Pipelines for ML

Firstrand Bank Limited; Johannesburg; Sur place; ZAR 700 000 - 1 200 000; Plein temps

Avantages offerts par ce poste

Medical, dental, and vision insurance

Performance bonuses

Professional development opportunities

Ample paid time off

Retirement savings plan

Résumé du poste

Firstrand Bank Limited in Randburg, Gauteng, seeks an experienced AI/ML Data Engineer to build and maintain robust data pipelines and infrastructure for analytics initiatives.

You will collect, clean, transform, and manage large datasets to ensure readiness for data scientists and ML engineers, emphasizing data quality and efficient storage. This role offers growth in a forward-thinking financial institution.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
• 3+ years of experience in data engineering, supporting AI/ML workloads.
• Proficiency in SQL with relational and NoSQL databases.
• Experience with ETL tools and frameworks (Spark, Pandas, Airflow).
• Python or Scala programming experience.
• Familiar with cloud data platforms (AWS, Azure, GCP).
• Understanding of data warehousing and big data concepts.
• Strong problem-solving and analytical skills.
• Excellent communication and teamwork abilities.
• Data modeling experience is a plus.

Responsabilités

• Design, build, and maintain scalable data pipelines for AI/ML projects.
• Develop and implement ETL processes to extract, transform, and load data from multiple sources.
• Ensure data quality, integrity, and consistency across data systems.
• Collaborate with data scientists and ML engineers to understand data requirements.
• Optimize data storage and retrieval for performance and efficiency.
• Manage and maintain databases and data warehouses.
• Implement data governance and security best practices.
• Develop tools and scripts to automate data-related tasks.
• Monitor data pipeline performance and troubleshoot issues.
• Stay current with emerging data engineering technologies and best practices.

Connaissances

SQL

Python

Scala

ETL

Cloud platforms

Data modeling

Data warehousing

Big data

Teamwork

Problem-solving

Formation

Bachelor's degree in Computer Science/Information Technology/Engineering

Outils

Apache Spark

Pandas

Airflow

Description du poste

Firstrand Bank Limited in Randburg, Gauteng, seeks an experienced AI/ML Data Engineer to build and maintain robust data pipelines and infrastructure for analytics initiatives.

You will collect, clean, transform, and manage large datasets to ensure readiness for data scientists and ML engineers, emphasizing data quality and efficient storage. This role offers growth in a forward-thinking financial institution.