Remote Data Platform Engineer: Real-Time CDC on Azure

Software Mind; Warszawa; On-site; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Flexible employment and remote work

International projects with leading全球l

International business trips

Non-corporate atmosphere

Language classes

Internal & external training

Private healthcare and insurance

Multisport card

Job summary

Software Mind is seeking a data/platform engineer to build and operate streaming pipelines for a global client base. You’ll work with PostgreSQL to Azure flows, using Kafka Connect and Debezium, running on Kubernetes (AKS), and you’ll automate everything with Python.

The role focuses on CDC pipelines, data protection, and scalable cloud integration. You will own configuration, scaling, monitoring, and IaC practices, collaborating with Azure data services such as Event Hubs and ADLS, Databricks,

Qualifications

• Solid commercial experience as a data/platform engineer focused on streaming/CDC pipelines.
• Hands-on Kafka knowledge with at least one Kafka Connect deployment you ran yourself.
• Strong SQL and PostgreSQL skills with WAL, replication slots and lag understanding.
• Working understanding of CDC concepts: initial snapshots, inserts/updates/deletes, event ordering.
• Proficient Python for automation and tooling.
• Experience with Azure data services (Event Hubs, ADLS, Azure PostgreSQL).
• Experience with Kubernetes for deploying workloads and secret management.
• Ability to diagnose pipelines using metrics and logs (throughput vs backpressure).

Responsibilities

• Build and operate CDC pipelines from PostgreSQL into Azure using Kafka Connect and Debezium.
• Configure, deploy and scale connectors end-to-end.
• Run pipelines on AKS; manage config, secrets, networking, and tuning.
• Monitor and troubleshoot production platform (retries, failures, throughput).
• Automate onboarding of new data sources and orchestration in Python.
• Integrate CDC streams with Azure data stack (Event Hubs, ADLS, Azure PostgreSQL, ADF, Databricks).
• Manage infrastructure as code for reproducibility and review.
• Apply data protection controls: masking, hashing, access control, retention.

Skills

Kafka

PostgreSQL

Python

Azure

Kubernetes

SQL

CDC pipelines

Tools

Debezium

AKS

Terraform

Bicep

Databricks

ADF

Job description

Software Mind is seeking a data/platform engineer to build and operate streaming pipelines for a global client base. You’ll work with PostgreSQL to Azure flows, using Kafka Connect and Debezium, running on Kubernetes (AKS), and you’ll automate everything with Python.

The role focuses on CDC pipelines, data protection, and scalable cloud integration. You will own configuration, scaling, monitoring, and IaC practices, collaborating with Azure data services such as Event Hubs and ADLS, Databricks,