Senior Data Engineer: Python, Aws & Ml Pipelines

Lever, Inc.; South Africa; Ibrido; ZAR 648.000 - 1.080.000; Tempo pieno

Vantaggi offerti da questo lavoro

Hybrid work model

Health, dental, and retirementBenefits

Professional development, conferences

Collaborative and innovative workplace

Descrizione del lavoro

Lever, Inc. in Sandton seeks an experienced Senior Data Engineer with a strong AI/ML focus to design, build, and maintain scalable data pipelines and infrastructure powering cutting-edge AI initiatives. This hybrid role combines in-office collaboration with flexible remote work.

You will work closely with data scientists and AI researchers to ensure data is clean, accessible, and optimized for model training and deployment while adhering to governance and security standards.

Competenze

• Bachelor’s or Master’s degree in CS, Engineering or a related quantitative field.
• 5+ years of data engineering experience building AI/ML data infrastructure.
• Strong SQL and NoSQL, data warehousing, Spark and Hadoop experience.
• Experience with cloud data platforms (AWS/Azure/GCP) and orchestration tools.
• Familiarity with ML data requirements and experimentation data pipelines.

Mansioni

• Design and maintain scalable data pipelines for AI/ML workloads.
• Collaborate with data scientists to meet data needs and quality standards.
• Ensure data quality, integrity, and security across platforms.
• Implement data governance and best practices in AI contexts.
• Optimize data ingestion, transformation, and storage processes.

Conoscenze

SQL

NoSQL

Data Warehousing

Big Data

Spark

Hadoop

Cloud Platforms

ETL/ELT

Data Governance

AI/ML Data

Formazione

Bachelor's or Master's in CS/Engineering

Strumenti

Spark

Hadoop

Airflow

Descrizione del lavoro

Our client is seeking an experienced Senior Data Engineer with a strong focus on AI and Machine Learning to join their team in Sandton. In this hybrid role, you will be instrumental in designing, building, and maintaining scalable data pipelines and infrastructure that power our advanced AI initiatives. You will work closely with data scientists and AI researchers to ensure data is clean, accessible, and optimized for model training and deployment. This is an excellent opportunity for a data engineering expert passionate about enabling cutting‑edge AI solutions and contributing to data‑driven innovation within a dynamic environment.

About the Role

Our client is seeking an experienced Senior Data Engineer with a strong focus on AI and Machine Learning to join their team in Sandton. In this hybrid role, you will be instrumental in designing, building, and maintaining scalable data pipelines and infrastructure that power our advanced AI initiatives. You will work closely with data scientists and AI researchers to ensure data is clean, accessible, and optimized for model training and deployment. This is an excellent opportunity for a data engineering expert passionate about enabling cutting‑edge AI solutions and contributing to data‑driven innovation within a dynamic environment.

Key Responsibilities

• Design, construct, install, test, and maintain highly scalable data management systems and pipelines for AI/ML applications.
• Develop and optimize data ingestion, transformation, and storage processes using big data technologies.
• Collaborate with data scientists and AI engineers to understand their data requirements and provide robust data solutions.
• Ensure data quality, integrity, and security across all data platforms.
• Implement data governance and best practices for data management in an AI context.

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related quantitative field.
• 5+ years of experience in data engineering, with a proven track record in building data infrastructure for AI/ML.
• Strong proficiency in SQL and NoSQL databases, data warehousing, and big data technologies (e.g., Spark, Hadoop).
• Experience with cloud data platforms (AWS, Azure, GCP) and data pipeline orchestration tools.
• Familiarity with machine learning concepts and the data requirements for AI model development.

Benefits

• Competitive salary and performance‑based bonuses.
• Hybrid work model providing a balance of in‑office and remote work.
• Comprehensive health, dental, and retirement benefits.
• Opportunities for professional development, certifications, and attending conferences.
• A collaborative and innovative workplace culture.

Reference number: NG60844. Salary: up to R1.08mil per annum (salary negotiable based on experience).