Senior Data Engineer – Real-Time Data & AI on GCP

Talentedge; Kraków; On-site; PLN 200,000 - 350,000; Full time

Job summary

Talentedge in Kraków is seeking a Senior Data Engineer to design, build and operate production-grade data pipelines on a modern GCP-based platform. You will work across batch and real-time environments, crafting robust data solutions with Python and SQL and building trusted data for analytics and AI/ML initiatives.

The role emphasizes data quality, observability, and adherence to engineering standards, with opportunities to mentor peers and influence platform design within a global fintech

Qualifications

• Proven track record building production data pipelines on GCP.
• Strong SQL and Python skills.
• Experience with Kafka or similar streaming systems.
• Familiar with BigQuery, Airflow, and GCS.
• Experience with dbt and data transformation.
• Understanding of Medallion architecture.
• Experience in regulated environments.

Responsibilities

• Design and build scalable batch and real-time data pipelines.
• Develop Kafka-based streams and Airflow workflows.
• Create and optimize data models in BigQuery.
• Maintain ingestion connectors and data integrations.
• Implement data quality, observability, and SLOs.
• Contribute to engineering standards and CI/CD practices.
• Support data science and AI-ready data initiatives.
• Mentor junior engineers and support team growth.

Skills

SQL

Python

GCP

Apache Kafka

BigQuery

Airflow/Cloud Composer

dbt

Medallion architecture

Data quality/observability

CI/CD

Tools

BigQuery

Airflow

Cloud Composer

GCS

Kafka

dbt

Cloud Run

Job description

Talentedge in Kraków is seeking a Senior Data Engineer to design, build and operate production-grade data pipelines on a modern GCP-based platform. You will work across batch and real-time environments, crafting robust data solutions with Python and SQL and building trusted data for analytics and AI/ML initiatives.

The role emphasizes data quality, observability, and adherence to engineering standards, with opportunities to mentor peers and influence platform design within a global fintech