Semantic Backend Engineer: Pipelines & Embeddings

Infuse; Durban; Remote; ZAR 500 000 - 800 000; Full time

Job summary

A tech-driven company in Durban is searching for an applied ML engineer to manage the semantic ingestion pipeline and enhance content relevance. The ideal candidate will have extensive experience with ML pipelines, working with tools like Python and PyTorch, and will contribute to improving how resources are tagged and utilized. This position offers the chance to work with cutting-edge technology in a dynamic environment.

Qualifications

• Experience building ML pipelines that impact real users.
• Background in semantic search, embeddings, or large-scale tagging.
• Ability to manage unstructured data efficiently.

Responsibilities

• Own the ETL pipeline and ensure resource quality.
• Implement models for summarization and classification.
• Collaborate on UX integration and content tagging.

Skills

Python

PyTorch

sentence-transformers

OpenAI APIs

FastAPI

Milvus

pgvector

Docker

Tools

Airflow

Lambda

Athena

Redshift SQL

PyPDF

Tika

Job description

A tech-driven company in Durban is searching for an applied ML engineer to manage the semantic ingestion pipeline and enhance content relevance. The ideal candidate will have extensive experience with ML pipelines, working with tools like Python and PyTorch, and will contribute to improving how resources are tagged and utilized. This position offers the chance to work with cutting-edge technology in a dynamic environment.