About the Role
Our client is actively seeking a skilled AI/ML Data Engineer to join their expanding team. This is a fully remote position, allowing you to contribute from anywhere within South Africa while working on critical AI and machine learning initiatives. You will be responsible for building and maintaining robust, scalable data pipelines that feed into our machine learning models. This role requires a strong foundation in data engineering principles, coupled with an understanding of AI/ML workflows. You will work closely with data scientists and AI researchers to ensure data quality, accessibility, and efficiency, enabling the development and deployment of impactful AI solutions.
Key Responsibilities
- Design, build, and maintain scalable and reliable data pipelines for AI and machine learning applications.
- Develop ETL/ELT processes to ingest, transform, and load data from various sources.
- Ensure data quality, integrity, and availability for data science and ML teams.
- Collaborate with data scientists to understand their data requirements and provide solutions.
- Optimize data infrastructure and pipelines for performance, cost-efficiency, and scalability.
- Implement data governance and security best practices.
- Work with cloud platforms (e.g., AWS, Azure, GCP) and big data technologies.
- Monitor and troubleshoot data pipeline issues, ensuring continuous operation.
- Contribute to the development and implementation of data warehousing and data lake solutions.
Requirements
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
- 3+ years of experience in data engineering, with a focus on supporting AI/ML projects.
- Proficiency in SQL and experience with relational and non-relational databases.
- Experience building data pipelines using tools like Apache Airflow, Luigi, or similar orchestration tools.
- Familiarity with big data technologies such as Spark, Hadoop, Kafka, or similar.
- Experience with cloud platforms (AWS, Azure, or GCP) and their data services.
- Understanding of data warehousing concepts and data modeling.
- Basic understanding of AI/ML concepts and workflows is beneficial.
- Strong problem‑solving skills and attention to detail.
- Excellent communication skills and the ability to work effectively in a remote team environment.
Benefits
- Our client offers a competitive salary, comprehensive benefits package, and the flexibility of a fully remote work environment. You will have the opportunity to work on challenging and impactful projects that drive innovation in AI and machine learning. We provide continuous learning opportunities and support professional development. Join a growing company where your contributions are valued, and you can make a significant impact on our data-driven initiatives.