Remote AI Data Engineer: LLM Pipelines & Scraping

e-Merge IT Recruitment

South Africa

Remote

ZAR 739,000 - 1,052,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

E-Merge seeks a capable Data Engineer to design scalable data pipelines, build AI-powered workflows, and develop autonomous systems interfacing with tools, APIs, databases, and enterprise data sources. You will implement production-grade scraping, data acquisition, and data quality controls in collaboration with engineering teams.

The role emphasizes hands-on building of pipelines and AI-enabled automation, with production-ready architectures and secure engineering practices.

Qualifications

  • Strong experience with Python and/or Node.js/TypeScript.
  • Advanced SQL and relational database skills.
  • Proven experience building production-grade data pipelines.
  • Experience with AWS or similar cloud platforms.
  • Hands-on experience with data lakes, warehouses, or lakehouse technologies.
  • Practical experience using LLM platforms such as OpenAI, Anthropic, Gemini, Bedrock, or similar.
  • Experience building agentic workflows involving tool use, task decomposition, retrieval systems, memory, and human-in-the-loop workflows.
  • Experience with scraping frameworks such as Playwright, Puppeteer, Scrapy, or Selenium.
  • Strong understanding of APIs, containers, CI/CD, testing, and secure engineering practices.

Responsibilities

  • Design and build scalable batch and near-real-time data pipelines.
  • Ingest and process data from APIs, databases, files, event streams, and web sources.
  • Develop and maintain large-scale scraping and data acquisition systems.
  • Build LLM-powered workflows and agentic AI solutions using tool calling, structured outputs, and RAG.
  • Support modern data lake, warehouse, and lakehouse architectures.
  • Implement monitoring, observability, schema validation, and data quality controls.
  • Collaborate with engineering teams to deliver secure, scalable production systems.

Skills

Python
Node.js/TypeScript
SQL
AWS
LLM platforms
Agentic workflows
APIs
Containers
CI/CD

Tools

Playwright
Puppeteer
Scrapy
Selenium

Job description

E-Merge seeks a capable Data Engineer to design scalable data pipelines, build AI-powered workflows, and develop autonomous systems interfacing with tools, APIs, databases, and enterprise data sources. You will implement production-grade scraping, data acquisition, and data quality controls in collaboration with engineering teams.

The role emphasizes hands-on building of pipelines and AI-enabled automation, with production-ready architectures and secure engineering practices.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer: AI Pipelines & Agentic Systems
Lead Data Engineer: AI Pipelines & Agentic Systems

Placements24 • Gauteng

Remote
ZAR 739,000 - 1,052,000
Remote AI Engineer: Build Scalable LLM Systems
Remote AI Engineer: Build Scalable LLM Systems

e-Merge IT Recruitment • Johannesburg

Remote
ZAR 480,000 - 800,000
Remote work
Remote AI Engineer: Build Scalable ML & LLM Systems
Remote AI Engineer: Build Scalable ML & LLM Systems

e-Merge IT Recruitment • South Africa

Remote
ZAR 480,000 - 800,000
Remote AI Data Engineer — Build Scalable Pipelines
Remote AI Data Engineer — Build Scalable Pipelines

Placements24 • Klerksdorp

Hybrid
ZAR 600,000 - 900,000
Medical aid
Retirement contributions
Remote-first culture
Remote AI Data Engineer: Scalable Pipelines for ML
Remote AI Data Engineer: Scalable Pipelines for ML

Placements24 • East London

Hybrid
ZAR 700,000 - 1,100,000
Remote-first culture
Health benefits
Professional development
Remote AI/ML Data Engineer: Scalable Pipelines & Data Quality
Remote AI/ML Data Engineer: Scalable Pipelines & Data Quality

Placements24 • Upington

Hybrid
ZAR 700,000 - 1,200,000
Competitive salary
Health benefits
Paid time off
+3
Data Engineer: AI/LLM & Modern Data Pipelines
Data Engineer: AI/LLM & Modern Data Pipelines

PBT Group • Cape Town

On-site
ZAR 600,000 - 900,000
Lead Data Engineer
Lead Data Engineer

Placements24 • Gauteng

Remote
ZAR 739,000 - 1,052,000
Generative AI Engineer — Data Pipelines & MLOps
Generative AI Engineer — Data Pipelines & MLOps

iqbusiness • Johannesburg

On-site
ZAR 900,000 - 1,700,000
Data Engineer: Pipelines for AI & Big Data Analytics
Data Engineer: Pipelines for AI & Big Data Analytics

Spatialedge • South Africa

On-site
ZAR 600,000 - 900,000