AI/ML Data Engineer

Placements24; LegKraal Gate; Hybrid; ZAR 900,000 - 1,500,000; Full time

Benefits offered by this job

Competitive salary and incentives

Health, dental and vision benefits

Generous paid time off

Professional development opportunities

Modern data infrastructure and tools

Hybrid work model

Collaborative team environment

Career advancement opportunities

Job summary

Placements24 seeks an experienced AI/ML Data Engineer to design, build and optimize scalable data pipelines and data warehouses for AI applications. You will collaborate with data scientists and ML engineers, ensuring data quality, governance and security across cloud platforms.

The role emphasizes hands-on data infrastructure, data modeling and ETL/ELT automation in a hybrid work setup, with opportunities for professional growth in a leading AI-focused company.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.
• 3+ years of experience in data engineering, with a focus on supporting AI/ML initiatives.
• Strong proficiency in SQL and experience with relational and NoSQL databases.
• Hands-on experience with big data technologies (e.g., Spark, Hadoop, Kafka).
• Experience with cloud data services (e.g., AWS S3/Glue/Redshift, Azure Data Lake/Databricks, Google Cloud Storage/BigQuery).
• Proficiency in programming languages like Python or Scala.
• Understanding of data modeling and data warehousing concepts.
• Experience with ETL/ELT tools and frameworks.
• Familiarity with MLOps principles and data pipeline automation is a plus.
• Excellent analytical and problem-solving skills.
• Strong communication and collaboration skills for a hybrid team.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines for AI/ML workloads.
• Develop and manage data lakes and data warehouses on cloud platforms (e.g., AWS, Azure, GCP).
• Ensure data quality, integrity, and consistency across various data sources.
• Collaborate closely with data scientists and ML engineers to understand data requirements.
• Optimize data retrieval and processing for efficient model training and inference.
• Implement data governance and security best practices.
• Automate data processes and monitoring systems.
• Explore and integrate new data sources and technologies.
• Troubleshoot and resolve data-related issues in production environments.
• Contribute to the architectural design of data solutions for AI applications.

Skills

SQL

NoSQL databases

Big data

Cloud platforms

Python/Scala

ETL/ELT

MLOps

Data modeling

Data warehousing

Analytical thinking

Communication

Education

Bachelor's degree in Computer Science/Engineering/IT

Tools

Spark

Hadoop

Kafka

AWS S3/Glue/Redshift

Azure Databricks

Google Cloud BigQuery

Job description

About the Role

Our client, a pioneering force in AI-driven solutions, is seeking an experienced AI/ML Data Engineer to join their dynamic team in Mahikeng, North West . This role is pivotal in building and maintaining the robust data infrastructure that fuels their advanced machine learning models and artificial intelligence applications. You will be responsible for designing, implementing, and optimizing data pipelines, ensuring the availability, quality, and efficiency of data for ML teams. The ideal candidate possesses a strong background in data engineering, a solid understanding of data warehousing concepts, and hands-on experience with big data technologies and cloud platforms. This position offers a fantastic opportunity to work with large-scale datasets and cutting-edge AI technologies in a collaborative environment. The role embraces a hybrid work model, providing flexibility between office-based teamwork and remote work. We are looking for a detail-oriented individual who is passionate about enabling data-driven innovation and ensuring that high-quality data is readily accessible for AI development and deployment.

Key Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines for AI/ML workloads.
• Develop and manage data lakes and data warehouses on cloud platforms (e.g., AWS, Azure, GCP).
• Ensure data quality, integrity, and consistency across various data sources.
• Collaborate closely with data scientists and ML engineers to understand data requirements.
• Optimize data retrieval and processing for efficient model training and inference.
• Implement data governance and security best practices.
• Automate data processes and monitoring systems.
• Explore and integrate new data sources and technologies.
• Troubleshoot and resolve data-related issues in production environments.
• Contribute to the architectural design of data solutions for AI applications.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Technology, or a related quantitative field.
• 3+ years of experience in data engineering, with a focus on supporting AI/ML initiatives.
• Strong proficiency in SQL and experience with relational and NoSQL databases.
• Hands-on experience with big data technologies (e.g., Spark, Hadoop, Kafka).
• Experience with cloud data services (e.g., AWS S3/Glue/Redshift, Azure Data Lake/Databricks, Google Cloud Storage/BigQuery).
• Proficiency in programming languages like Python or Scala.
• Understanding of data modeling and data warehousing concepts.
• Experience with ETL/ELT tools and frameworks.
• Familiarity with MLOps principles and data pipeline automation is a plus.
• Excellent analytical and problem-solving skills.
• Strong communication and collaboration skills for a hybrid team.

Benefits

• Competitive salary and performance incentives.
• Comprehensive health, dental, and vision benefits.
• Generous paid time off and company holidays.
• Opportunities for professional development and training.
• Access to modern data infrastructure and tools.
• Hybrid work model offering flexibility and work-life balance.
• Collaborative and innovative team environment.
• Career advancement opportunities within an AI-focused company.