Data Engineer: Fintech Multi-Tenant Etl & Analytics

Competent Candidates; Gauteng; Hybrid; ZAR 720,000 - 980,000; Full time

Benefits offered by this job

Competitive salary

Hybrid work model

Growth opportunities

Job summary

Competent Candidates in Soweto is seeking an AI/ML Data Engineer to build and maintain data pipelines and infrastructure supporting AI initiatives. You will collect, clean, transform, and manage large datasets, ensuring they are optimized for model training and analysis in a hybrid work setting.

You will collaborate with data scientists and AI researchers to provide high-quality data foundations for developing and deploying sophisticated AI solutions, unlocking data-driven insights.

Qualifications

• 3+ years of experience in data engineering, with a focus on AI/ML projects.
• Proficiency in SQL and programming languages such as Python or Scala.
• Experience with big data platforms like Spark, Hadoop, or similar.
• Familiarity with cloud data services (AWS, Azure, GCP) and data warehousing concepts.
• Strong understanding of data governance, data quality, and data security principles.

Responsibilities

• Design, build, and maintain scalable data pipelines for AI and machine learning workloads.
• Develop ETL processes to ingest, clean, transform, and aggregate data from various sources.
• Ensure data quality, integrity, and accessibility for data scientists and analysts.
• Implement data warehousing and data lake solutions to support big data analytics.
• Optimize data infrastructure for performance, scalability, and cost-effectiveness.
• Collaborate with data scientists to understand data requirements and prepare data for model training and evaluation.

Job description

Our client is seeking a skilled AI/ML Data Engineer to join their advanced analytics team in Soweto. This role is fundamental to building and maintaining the data pipelines and infrastructure necessary to support our client's AI and machine learning initiatives. You will be responsible for collecting, cleaning, transforming, and managing large datasets, ensuring they are optimized for model training and analysis. Working within a hybrid model, you will collaborate closely with data scientists and AI researchers to provide the high-quality data foundations needed for developing and deploying sophisticated AI solutions, playing a key part in unlocking data-driven insights.

About the Role

Our client is seeking a skilled AI/ML Data Engineer to join their advanced analytics team in Soweto. This role is fundamental to building and maintaining the data pipelines and infrastructure necessary to support our client's AI and machine learning initiatives. You will be responsible for collecting, cleaning, transforming, and managing large datasets, ensuring they are optimized for model training and analysis. Working within a hybrid model, you will collaborate closely with data scientists and AI researchers to provide the high-quality data foundations needed for developing and deploying sophisticated AI solutions, playing a key part in unlocking data-driven insights.

Key Responsibilities

• Design, build, and maintain scalable data pipelines for AI and machine learning workloads.
• Develop ETL processes to ingest, clean, transform, and aggregate data from various sources.
• Ensure data quality, integrity, and accessibility for data scientists and analysts.
• Implement data warehousing and data lake solutions to support big data analytics.
• Optimize data infrastructure for performance, scalability, and cost-effectiveness.
• Collaborate with data scientists to understand data requirements and prepare data for model training and evaluation.

Requirements

• Bachelor\u2019s degree in Computer Science, Engineering, Statistics, or a related quantitative field.
• 3+ years of experience in data engineering, with a focus on supporting AI/ML projects.
• Proficiency in SQL and programming languages such as Python or Scala.
• Experience with big data platforms like Spark, Hadoop, or similar.
• Familiarity with cloud data services (AWS, Azure, GCP) and data warehousing concepts.
• Strong understanding of data governance, data quality, and data security principles.

Benefits

• Competitive salary and comprehensive benefits package.
• Opportunities for professional growth and training in AI and data technologies.
• Hybrid work model offering flexibility.
• Contribute to critical data infrastructure that powers advanced AI capabilities.