AI Data Curator / Data Engineer

DataLens Africa; United States; Hybrid; USD 3,000 - 7,400; Full time

Benefits offered by this job

Remote work option

Learning opportunities

Room for professional growth

Job summary

DataLens Africa is seeking a data engineer to build and maintain pipelines that produce clean, dependable datasets for AI and machine learning work. You will connect data engineering with curation and quality assurance to prepare data for model training.

Responsibilities include coordinating with annotation and QA teams, automating dataset validation and storage, and improving data curation tools and workflows to support AI applications.

Qualifications

• Proficiency in Python or SQL for data processing.
• Experience with Pandas, NumPy, or PySpark.
• Experience with cloud data platforms such as AWS, GCP, or Azure.
• Understanding of data quality, ETL, and ML pipelines.
• Strong analytical and problem-solving skills.

Responsibilities

• Create and maintain pipelines for collecting, cleaning, and transforming data.
• Coordinate with annotation and quality assurance teams to protect dataset integrity.
• Automate dataset validation and storage processes.
• Work with AI engineers to prepare datasets for model training.
• Improve data curation processes and supporting tools.

Skills

Python

SQL

Pandas

NumPy

PySpark

AWS

GCP

Azure

ETL

Data quality

ML pipelines

Job description

Role overview

Build and maintain data pipelines that produce clean, dependable datasets for AI and machine learning work. The role connects data engineering with curation and quality assurance, helping prepare data for model training and improve the workflows used to manage it.

Responsibilities

• Create and maintain pipelines for collecting, cleaning, and transforming data.
• Coordinate with annotation and quality assurance teams to protect dataset integrity.
• Automate dataset validation and storage processes.
• Work with AI engineers to prepare datasets for model training.
• Improve data curation processes and supporting tools.

Requirements

• Proficiency in Python, SQL, or a similar language for data processing.
• Familiarity with Pandas, NumPy, or PySpark.
• Experience with a cloud data platform such as AWS, Google Cloud, or Azure.
• Understanding of data quality, ETL, and machine learning pipelines.
• Strong analytical and problem-solving skills.

Benefits and work setup

• Full-time role based remotely or in Lagos, Nigeria.
• Flexible work, learning opportunities, and room for professional growth.
• Work with a team focused on dataset quality and AI applications.