Remote Data Platform Engineer - Streaming & CDC

Software Mind; Warszawa; Hybrid; PLN 180,000 - 300,000; Full time

Job summary

Software Mind seeks a Data/Platform Engineer to own streaming CDC pipelines from PostgreSQL into Azure. You’ll use Kafka Connect and Debezium on AKS, manage connectors and offsets, and automate data ingestion with Python.

The role integrates with Event Hubs, ADLS, Databricks and ADF, while enforcing data protection and IaC principles. You’ll collaborate with teams on scalable, compliant data pipelines for global clients in a flexible remote setup, with opportunities to influence architecture and

Qualifications

• Solid commercial experience in data/platform engineering with streaming or CDC pipelines.
• Practical Kafka knowledge including topics, partitions, offsets and consumer groups.
• Strong SQL and PostgreSQL skills, with WAL and replication concepts.
• Understanding of CDC concepts, snapshots, inserts/updates/deletes and ordering.
• Proficient Python for automation, testing and orchestration.
• Hands-on experience with Azure data services and Kubernetes usage.
• Familiarity with IaC and CI/CD for data platforms.

Responsibilities

• Build and operate CDC pipelines from PostgreSQL into Azure using Kafka Connect and Debezium.
• Configure, deploy and scale connectors end to end and manage offsets and schema history.
• Run stateful workloads on AKS with configuration, secrets and resource tuning.
• Monitor production pipelines, troubleshoot failures, rebalances and recovery.
• Automate platform onboarding of new data sources and testing workflows in Python.
• Integrate CDC streams with Azure data stack (Event Hubs, ADLS, Databricks, ADF).
• Manage infrastructure as code for reproducible environments.
• Enforce data protection controls: masking, hashing, access control and retention.

Skills

Kafka

PostgreSQL

Python

Azure

Kubernetes

Tools

Kafka Connect

Debezium

Terraform

Databricks

ADF

Job description

Software Mind seeks a Data/Platform Engineer to own streaming CDC pipelines from PostgreSQL into Azure. You’ll use Kafka Connect and Debezium on AKS, manage connectors and offsets, and automate data ingestion with Python.

The role integrates with Event Hubs, ADLS, Databricks and ADF, while enforcing data protection and IaC principles. You’ll collaborate with teams on scalable, compliant data pipelines for global clients in a flexible remote setup, with opportunities to influence architecture and