Senior Data Engineer: Real-Time GCP CDC Pipelines - Remote

N-iX; Portugal; Remote; EUR 90,000 - 140,000; Full time

Benefits offered by this job

Flexible working format

Salary package

Career growth

Mentorship programs

Education reimbursement

Team events

Knowledge sharing

Job summary

N-iX is seeking a Senior Data Engineer to design, scale, and maintain high-performance ingestion, CDC, and delivery pipelines. Architect enterprise-grade data platforms for large-scale metadata and asset datasets, leveraging GCP as the compute foundation.

You will work with Snowflake, ClickHouse, dbt Core, Airflow, Python and SQL, building end-to-end data pipelines for real-time delta updates and analytics across hybrid environments.

Qualifications

• 4+ years of production experience with core GCP data technologies (BigQuery, Dataflow, Pub/Sub, GKE, Cloud Storage).
• Deep proficiency with Snowflake and ClickHouse for warehousing and real-time analytics.
• Experience architecting CDC pipelines and incremental delta loading for multi-terabyte datasets.
• Hands-on mastery of dbt Core/Cloud and Apache Airflow in an enterprise CI/CD setting.

Responsibilities

• Architect, build, and optimize scalable ingestion pipelines on GCP.
• Design robust CDC and incremental processing workflows for fast delta synchronization.
• Develop dbt transformation models and Airflow orchestrations following Data Vault patterns.
• Implement delta tracking methods to monitor asset modifications and metadata events.
• Maintain and optimize Snowflake integration layers and deploy ClickHouse for high-concurrency analytics.
• Create integration views and API layers for real-time delta updates.
• Collaborate with cross-functional teams to integrate metadata pipelines with feature extraction and licensing platforms.

Skills

Python

SQL

Go

Java

Scala

Tools

GCP

BigQuery

Dataflow

Pub/Sub

Cloud Storage

GKE

Snowflake

ClickHouse

dbt Core

Apache Airflow

Job description

N-iX is seeking a Senior Data Engineer to design, scale, and maintain high-performance ingestion, CDC, and delivery pipelines. Architect enterprise-grade data platforms for large-scale metadata and asset datasets, leveraging GCP as the compute foundation.

You will work with Snowflake, ClickHouse, dbt Core, Airflow, Python and SQL, building end-to-end data pipelines for real-time delta updates and analytics across hybrid environments.