Python Data Engineer — Backend for Next-Gen Data Platform

Confluence Technologies, Inc.; Cape Town; Hybrid; ZAR 420,000 - 720,000; Full time

Benefits offered by this job

Time Off packages

Global Career Development

Social Events

Referral Bonus scheme

Job summary

Confluence Technologies, Inc. is seeking a Software Engineer for the Data Team in Cape Town. You will work on the data API within a multi-tenant platform, migrating logic to Python and ensuring high data quality and performance.

You’ll collaborate across the data platform, contributing to architecture and deployment via Azure DevOps and Docker, with focus on data correctness and scalable ETL for large datasets.

Qualifications

• Bachelor's degree in Software Engineering/development, Computer Science, or related field.
• 1-3 years of experience in software development.
• Strong proficiency in Python (3.12+) backend development — FastAPI, Pydantic v2, async/await — and T-SQL, with deep comfort in the data and service layers of an enterprise application.
• Expert-level SQL Server and data engineering: parameterized query authoring, query optimization and execution-plan analysis, indexing strategy, set-based processing, and bulk / ETL data movement and large-dataset performance tuning.
• Exposure to modern cloud data platforms and warehouses (e.g. Snowflake) and an interest in integrating multiple, heterogeneous data sources behind a unified API.

Responsibilities

• Help migrate logic from legacy stored procedures to Python.
• Develop and maintain the data API as part of a multi-tenant data platform.
• Ensure data correctness, performance, and large-data movement across sources.

Skills

Python backend

FastAPI

Pydantic

async/await

T-SQL

SQL Server

Data engineering

SQLAlchemy

Snowflake

Azure

DevOps

Docker

Education

Bachelor's degree in Software Engineering/Computer Science

Tools

Docker

Azure DevOps

SQL Server

Job description

Confluence Technologies, Inc. is seeking a Software Engineer for the Data Team in Cape Town. You will work on the data API within a multi-tenant platform, migrating logic to Python and ensuring high data quality and performance.

You’ll collaborate across the data platform, contributing to architecture and deployment via Azure DevOps and Docker, with focus on data correctness and scalable ETL for large datasets.