AI Data Engineer

Placements24; Klerksdorp; Ibrido; ZAR 600.000 - 900.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical aid

Retirement contributions

Remote-first culture

Descrizione del lavoro

Placements24 seeks an AI Data Engineer to join a fully remote technology team focused on AI/ML infrastructure. You will design, build, and optimize data pipelines, ensuring data quality and availability for model training and analysis.

Responsibilities include ETL/ELT, data warehouses/lakes, data dictionaries, security/compliance, and collaboration with data scientists. Remote-friendly environment with growth opportunities in a leading AI company.

Competenze

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
• Experience building data pipelines for AI/ML projects.
• Strong SQL proficiency with relational and NoSQL databases.
• Experience with big data technologies (Spark, Hadoop).
• Programming in Python, Scala, or Java.
• Experience with cloud data services (AWS, Azure, GCP).
• Knowledge of data warehousing concepts and data modeling.

Mansioni

• Design, build, and maintain scalable data pipelines for AI/ML applications.
• Develop ETL/ELT processes to ingest, transform, and load data from various sources.
• Implement data quality checks and validation processes.
• Optimize data storage and retrieval for performance and cost-efficiency.
• Collaborate with data scientists and ML engineers to understand data requirements.
• Build and manage data warehouses and data lakes.
• Develop and maintain data dictionaries and documentation.
• Monitor data pipeline performance and troubleshoot issues.
• Explore and implement new data technologies to enhance data infrastructure.
• Ensure data security and compliance with regulations.

Conoscenze

SQL

Data modeling

Data warehousing

Problem-solving

Communication

Python/Scala/Java

NoSQL

Formazione

Bachelor's degree in Computer Science/Engineering/Data Science

Strumenti

Apache Spark

Hadoop

AWS/Azure/GCP

Descrizione del lavoro

About the Role Our client is a dynamic and innovative technology firm recognized for its contributions to artificial intelligence. We are currently seeking a talented and motivated AI Data Engineer to join our fully remote team. This role is essential for building and maintaining the robust data infrastructure that powers our advanced AI and machine learning initiatives. You will be responsible for designing, constructing, and optimizing data pipelines, ensuring the quality, availability, and accessibility of data critical for model training and analysis. This is an excellent opportunity for a data-focused professional looking to make a significant impact in the rapidly evolving field of AI, working from anywhere. Our client is committed to fostering a collaborative and supportive remote work environment where your contributions are valued and recognized.

Key Responsibilities

• Design, build, and maintain scalable and reliable data pipelines for AI and machine learning applications.
• Develop ETL/ELT processes to ingest, transform, and load data from various sources.
• Implement data quality checks and validation processes to ensure data accuracy and consistency.
• Optimize data storage and retrieval mechanisms for performance and cost-efficiency.
• Collaborate with data scientists and ML engineers to understand data requirements and provide data solutions.
• Build and manage data warehouses and data lakes.
• Develop and maintain data dictionaries and documentation.
• Monitor data pipeline performance and troubleshoot any issues that arise.
• Explore and implement new data technologies and tools to enhance our data infrastructure.
• Ensure data security and compliance with relevant regulations.

Requirements

• Bachelor's degree in Computer Science, Engineering, Data Science, or a related field.
• Proven experience as a Data Engineer, with a focus on building data pipelines for AI/ML projects.
• Strong proficiency in SQL and experience with relational and NoSQL databases.
• Experience with big data technologies such as Apache Spark, Hadoop, or similar.
• Proficiency in at least one programming language commonly used in data engineering (e.g., Python, Scala, Java).
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Familiarity with data warehousing concepts and tools.
• Understanding of data modeling techniques.
• Excellent problem-solving skills and attention to detail.
• Strong communication skills suitable for a remote team environment.

Benefits

Our client offers a competitive salary, comprehensive benefits package including medical aid and retirement contributions, and significant opportunities for professional growth and development within a remote-first culture. You will have the flexibility to work from anywhere, contributing to groundbreaking AI projects. Enjoy a collaborative environment that values innovation and continuous learning. Join a leading AI company and advance your career in data engineering.