Senior Data Engineer - AI/ML Pipelines (Python/AWS)

Lever, Inc.; South Africa; Hybrid; ZAR 648,000 - 1,080,000; Full time

Benefits offered by this job

Hybrid work model

Health, dental, and retirementBenefits

Professional development, conferences

Collaborative and innovative workplace

Job summary

Lever, Inc. in Sandton seeks an experienced Senior Data Engineer with a strong AI/ML focus to design, build, and maintain scalable data pipelines and infrastructure powering cutting-edge AI initiatives. This hybrid role combines in-office collaboration with flexible remote work.

You will work closely with data scientists and AI researchers to ensure data is clean, accessible, and optimized for model training and deployment while adhering to governance and security standards.

Qualifications

• Bachelor’s or Master’s degree in CS, Engineering or a related quantitative field.
• 5+ years of data engineering experience building AI/ML data infrastructure.
• Strong SQL and NoSQL, data warehousing, Spark and Hadoop experience.
• Experience with cloud data platforms (AWS/Azure/GCP) and orchestration tools.
• Familiarity with ML data requirements and experimentation data pipelines.

Responsibilities

• Design and maintain scalable data pipelines for AI/ML workloads.
• Collaborate with data scientists to meet data needs and quality standards.
• Ensure data quality, integrity, and security across platforms.
• Implement data governance and best practices in AI contexts.
• Optimize data ingestion, transformation, and storage processes.

Skills

SQL

NoSQL

Data Warehousing

Big Data

Spark

Hadoop

Cloud Platforms

ETL/ELT

Data Governance

AI/ML Data

Education

Bachelor's or Master's in CS/Engineering

Tools

Spark

Hadoop

Airflow

Job description

Lever, Inc. in Sandton seeks an experienced Senior Data Engineer with a strong AI/ML focus to design, build, and maintain scalable data pipelines and infrastructure powering cutting-edge AI initiatives. This hybrid role combines in-office collaboration with flexible remote work.

You will work closely with data scientists and AI researchers to ensure data is clean, accessible, and optimized for model training and deployment while adhering to governance and security standards.