AI/ML Data Engineer

Placements24; Paarl; Hybrid; ZAR 600,000 - 900,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Learning opportunities

Competitive salary

Job summary

Placements24 is seeking an experienced AI/ML Data Engineer to design and maintain robust, scalable data pipelines supporting AI initiatives. This fully remote role lets you contribute from anywhere in South Africa.

You will collaborate with data scientists to ensure data quality and availability, develop ETL/ELT processes, and optimize data infrastructure across cloud platforms (AWS/Azure/GCP) for performance and cost-efficiency.

Qualifications

• Bachelor's degree or equivalent in a relevant field.
• Strong SQL skills and experience with data pipelines.
• Experience supporting AI/ML projects and data science teams.

Responsibilities

• Design, build, and maintain scalable data pipelines for AI/ML applications.
• Develop ETL/ELT processes to ingest, transform, and load data from multiple sources.
• Ensure data quality, integrity, and availability for data science teams.
• Collaborate with data scientists to understand requirements and provide data solutions.
• Optimize data infrastructure for performance, cost, and scalability.
• Implement data governance and security best practices.
• Work with cloud platforms (AWS, Azure, GCP) and big data tech.
• Monitor and troubleshoot pipelines to ensure continuous operation.
• Contribute to data warehousing and data lake initiatives.

Skills

SQL proficiency

Airflow

Big data tech

Cloud platforms

ETL/ELT design

Data modeling

Data governance

Remote collaboration

Data quality

Education

Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field

Tools

Apache Airflow

Spark

Hadoop

Job description

About the Role

Our client is actively seeking a skilled AI/ML Data Engineer to join their expanding team. This is a fully remote position, allowing you to contribute from anywhere within South Africa while working on critical AI and machine learning initiatives. You will be responsible for building and maintaining robust, scalable data pipelines that feed into our machine learning models. This role requires a strong foundation in data engineering principles, coupled with an understanding of AI/ML workflows. You will work closely with data scientists and AI researchers to ensure data quality, accessibility, and efficiency, enabling the development and deployment of impactful AI solutions.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for AI and machine learning applications.
• Develop ETL/ELT processes to ingest, transform, and load data from various sources.
• Ensure data quality, integrity, and availability for data science and ML teams.
• Collaborate with data scientists to understand their data requirements and provide solutions.
• Optimize data infrastructure and pipelines for performance, cost-efficiency, and scalability.
• Implement data governance and security best practices.
• Work with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies.
• Monitor and troubleshoot data pipeline issues, ensuring continuous operation.
• Contribute to the development and implementation of data warehousing and data lake solutions.

Requirements

• Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
• 3+ years of experience in data engineering, with a focus on supporting AI/ML projects.
• Proficiency in SQL and experience with relational and non-relational databases.
• Experience building data pipelines using tools like Apache Airflow, Luigi, or similar orchestration tools.
• Familiarity with big data technologies such as Spark, Hadoop, Kafka, or similar.
• Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
• Understanding of data warehousing concepts and data modeling.
• Basic understanding of AI/ML concepts and workflows is beneficial.
• Strong problem-solving skills and attention to detail.
• Excellent communication skills and the ability to work effectively in a remote team environment.

Benefits

Our client offers a competitive salary, comprehensive benefits package, and the flexibility of a fully remote work environment. You will have the opportunity to work on challenging and impactful projects that drive innovation in AI and machine learning. We provide continuous learning opportunities and support professional development. Join a growing company where your contributions are valued, and you can make a significant impact on our data-driven initiatives.