Software Engineer, Data Team

Confluence; Wes-Kaap; Hybrid; ZAR 420,000 - 780,000; Full time

Benefits offered by this job

Flexible working options

Career development

Social events

Job summary

Confluence is building a next‑generation data platform. You will work on a Python data API, migrate logic from legacy procedures, and focus on data correctness and performance, spanning multiple data sources in a unified API.

The role is backend‑and‑data centric, involving collaboration across the data team to shape the platform's architecture and future direction. Flexible working options are offered as the team scales.

Qualifications

• Bachelor's degree in Software Engineering/ Development or Computer Science.
• 1–3 years of software development experience.
• Strong Python backend development skills with FastAPI, Pydantic v2, and async/await.
• Expert SQL Server and data engineering experience, including parameterized queries, indexing, ETL, and performance tuning.
• Experience with Snowflake and SQLAlchemy or interest in integrating multiple data sources behind a unified API.

Responsibilities

• Migrate logic from legacy stored procedures into Python‑based data APIs.
• Work across the data platform focusing on data correctness, performance, and large‑dataset movement and reconciliation.
• Collaborate on defining the architecture and direction of the next‑generation data platform.

Skills

Python backend

FastAPI

Pydantic v2

async/await

T-SQL

SQL Server

Data engineering

Snowflake

SQLAlchemy

Education

Bachelor's degree in Software Engineering/ Development or Computer Science

Tools

SQL Server

Snowflake

SQLAlchemy

Job description

Department: Development - Software Development

Location: South Africa

Why Confluence?

At Confluence, we’ve always been driven by a commitment to innovation, precision, and partnership in the investment data space. Our global footprint now spans multiple countries, giving our employees the opportunity to get exposure to other countries and cultures. And it stands to reason that none of this would have been possible without the hundreds of hard‑working employees who work at Confluence.

Location: US -Cape Town, South Africa

More about the role & team

The Data Team is building the next‑generation data platform — a multi‑tenant platform that will become the shared data layer behind our applications. At the heart of that platform is a Python data API built on a layered router → service → repository architecture, containerized with Docker and deployed entirely through infrastructure‑as‑code. Today the platform is SQL Server‑heavy, and part of this role is migrating business and data logic out of legacy stored procedures into testable Python — parameterized SQL for retrieval, pandas for computation and reshaping. As we evolve, we intend to grow well beyond a single database — incorporating additional and modern data sources (for example, Snowflake, which the API's SQLAlchemy‑based connection registry is already designed to add) and the patterns needed to serve them through a unified API. This is a foundational, shaping role: you will help define the architecture and direction of that next‑generation platform, not just maintain what exists.

We are seeking a Software Engineer with a strong data‑engineering focus to join the Data Team. The role is primarily focused on the data API, but it is a team role rather than a single‑service one — you will work across the data platform as it grows. This is backend‑and data‑centric work: you will spend more time on data correctness, performance, and the movement and reconciliation of large datasets across heterogeneous sources than on any single framework or UI library. We value depth in the core technologies and engineering fundamentals over expertise in any specific component, and we expect enough Azure and DevOps capability to deploy and operate what you build.

What skills and experience do I need to succeed?

• Bachelor's degree in Software Engineering/development, Computer Science, or related field.
• 1-3 years of experience in software development.
• Strong proficiency in Python (3.12+) backend development — FastAPI, Pydantic v2, async/await — and T‑SQL, with deep comfort in the data and service layers of an enterprise application.
• Expert‑level SQL Server and data engineering: parameterized query authoring, query optimization and execution‑plan analysis, indexing strategy, set‑based processing, and bulk / ETL data movement and large‑dataset performance tuning — plus comfort migrating logic out of legacy stored procedures into Python.
• Exposure to modern cloud data platforms and warehouses (e.g. Snowflake) and an interest in integrating multiple, heterogeneous data sources — each just another SQLAlchemy dialect — behind a unified API.

What do we offer?

Confluence offers generous benefit packages for team members. As a growing, global organization, we are always looking for ways to ensure that our employees can access benefits that matter to them and their families. This includes:

• Generous Time Off packages including additional half days with each public holiday in your location.
• Global Career Development opportunities.
• Social Events.
• Referral Bonus scheme - Upto $3,000 per successful referral.
• Plus many more!

More about the Location

We offer flexible working options for all employees.

Values

We look for people who align with our 4 values.

• Integrity Face reality with honesty, courage and accountability
• Imagination Deal creatively with challenges and envision what the world could be
• Discipline Build good habits into reflexes which become a part of our life
• Service Committed to the success of others

AI Friendly Interview Process

We recognise that AI tools are becoming a standard part of how many people work. Candidates are welcome to use AI throughout our interview process. If you choose to use AI during an interview or assessment, we may ask you to share your screen so that we can better understand your thinking, decision making and approach to using the technology. Our aim is to assess your skills, experience, judgement and problem solving abilities, including how you make use of modern tools in a professional setting.