Senior Data Engineer - GCP, BigQuery & Real-Time Pipelines

Eagle Eye Staffing Solutions; Kraków; Hybrid; PLN 180,000 - 260,000; Full time

Job summary

IG is hiring to consolidate its data ecosystem onto GCP. The role involves building secure, reliable data solutions powering analytics, compliance and future AI/ML products. Kraków is offered with a hybrid model (3 days in office per week).

You will work on batch and real-time pipelines, GCP ingestion, dbt modelling and data governance in a regulated financial environment. Mentoring junior engineers and supporting ML data pipelines are part of the scope.

Qualifications

• Strong production experience with GCP, Python and SQL.
• Experience with BigQuery, Cloud Composer/Airflow, GCS and Cloud Run.
• Kafka or equivalent streaming technology.
• dbt and Bronze/Silver/Gold modelling knowledge.

Responsibilities

• Build batch and real-time pipelines using BigQuery, Kafka and Airflow.
• Develop GCP ingestion capabilities with GCS and Cloud Run.
• Create dbt transformations within a Medallion architecture.
• Implement data contracts, quality checks, lineage, observability and SLO monitoring.
• Improve CI/CD, engineering standards and shared datasets.
• Mentor junior engineers and support ML data pipelines.

Skills

GCP expertise

Python

SQL

Data governance

Regulated environment

Mentoring

Tools

BigQuery

Cloud Composer/Airflow

GCS

Cloud Run

Kafka

dbt

Job description

IG is hiring to consolidate its data ecosystem onto GCP. The role involves building secure, reliable data solutions powering analytics, compliance and future AI/ML products. Kraków is offered with a hybrid model (3 days in office per week).

You will work on batch and real-time pipelines, GCP ingestion, dbt modelling and data governance in a regulated financial environment. Mentoring junior engineers and supporting ML data pipelines are part of the scope.