GCP Data Engineer: Real-Time Pipelines & AI Readiness

IG Group; Kraków; Hybrid; PLN 180,000 - 240,000; Full time

Benefits offered by this job

Home office equipmentreimbursement

Performance relate bonus

Private medical cover for you and your

Family/partner (Medicover)

Multikafeteria system

Life insurance

LinkedIn Learning platform free access

Share Plans for Employees

Well-being events

Employee Assistance Programme

Summer picnic

Birthday + volunteering days

Parking spots booking

Stretching sessions

Job summary

IG Group in Kraków is seeking a Data Engineer to design and operate production-grade data pipelines on GCP, BigQuery, Airflow and related tools. You will contribute to IG’s data platform consolidation, ensure data quality, and enable self-service analytics across teams.

You’ll work in a hybrid setup (3 days in the office), mentor junior engineers, implement data contracts, lineage, and observability, and support AI-ready data pipelines for model development.

Qualifications

• Proven hands-on experience building and operating production-grade data pipelines on GCP—BigQuery, Cloud Composer/Airflow, GCS.
• Strong SQL and Python skills; Kafka experience for real-time data flows.
• Familiarity with dbt and Medallion architecture for self-service analytics.
• Experience in regulated financial services data governance and lineage.

Responsibilities

• Design and build robust batch and real-time data pipelines on GCP, including Kafka streams, BigQuery transforms, and Airflow workflows.
• Own data quality: contracts, data quality checks, observability, and SLAs for pipeline health.
• Develop and maintain in-house connectors and third-party integrations for IG’s ingestion estate with resilience and monitoring.
• Contribute to engineering standards, code reviews, CI/CD hygiene, and shared dataset change control.
• Support feature engineering and model data pipelines for Data Science and AI-ready data.

Skills

GCP data pipelines

BigQuery

Airflow

Kafka streaming

dbt modelling

SQL

Python

Data quality

CI/CD

Regulated fintech

Tools

BigQuery

Airflow

Kafka

dbt

GCS

Cloud Run

Job description

IG Group in Kraków is seeking a Data Engineer to design and operate production-grade data pipelines on GCP, BigQuery, Airflow and related tools. You will contribute to IG’s data platform consolidation, ensure data quality, and enable self-service analytics across teams.

You’ll work in a hybrid setup (3 days in the office), mentor junior engineers, implement data contracts, lineage, and observability, and support AI-ready data pipelines for model development.