Senior Data Engineer

Eagle Eye Staffing Solutions; Województwo małopolskie; On-site; PLN 180,000 - 260,000; Full time

Job summary

Eagle Eye Staffing Solutions (Poland) seeks a Senior Data Engineer to join a team building a modern data platform in a GCP environment. You design, build and operate scalable pipelines, work with BigQuery, Airflow, GCS and Cloud Run, and support ML/data science workloads.

You will ensure data quality, governance and observability, participate in code reviews and help shape data standards and architecture across Bronze/Silver/Gold layers.

Qualifications

• several years of hands-on experience building and operating production-grade data pipelines.
• strong practical knowledge of GCP, particularly BigQuery, Cloud Composer/Airflow, GCS and Cloud Run.
• strong SQL and Python skills.
• experience with Apache Kafka or other streaming technologies.
• experience with dbt and modern data transformation approaches.
• understanding of Medallion Architecture.
• experience with data quality, data contracts, lineage, observability and SLA/SLO monitoring.
• understanding of data governance and working with data in a regulated environment.
• strong problem-solving skills and the ability to work independently on complex, scalable solutions.

Responsibilities

• designing, building and operating scalable data pipelines on GCP, including both batch and real-time processing,
• working with BigQuery, Cloud Composer/Airflow, GCS and Cloud Run,
• developing and maintaining data ingestion processes, including Apache Kafka-based solutions,
• developing data transformations and working with dbt,
• ensuring data quality, monitoring, observability, lineage and pipeline reliability,
• contributing to Medallion Architecture (Bronze/Silver/Gold),
• supporting Data Science teams with data pipelines for ML and AI workloads,
• participating in code reviews and contributing to engineering standards and best practices,
• working with data governance requirements, access control, auditability and change management.

Skills

GCP

SQL

Python

Data pipelines

Data governance

Observability

SLA/SLO monitoring

Data quality

Medallion Architecture

Tools

BigQuery

Cloud Composer/Airflow

GCS

Cloud Run

Apache Kafka

dbt

Job description

We are looking for a Senior Data Engineer to join a team working on a modern data platform in a GCP environment.

Your responsibilities:

• designing, building and operating scalable data pipelines on GCP, including both batch and real-time processing,
• working with BigQuery, Cloud Composer/Airflow, GCS and Cloud Run,
• developing and maintaining data ingestion processes, including Apache Kafka-based solutions,
• developing data transformations and working with dbt,
• ensuring data quality, monitoring, observability, lineage and pipeline reliability,
• contributing to Medallion Architecture (Bronze/Silver/Gold),
• supporting Data Science teams with data pipelines for ML and AI workloads,
• participating in code reviews and contributing to engineering standards and best practices,
• working with data governance requirements, access control, auditability and change management.

Requirements:

• several years of hands-on experience building and operating production-grade data pipelines,
• strong practical knowledge of GCP, particularly BigQuery, Cloud Composer/Airflow, GCS and Cloud Run,
• strong SQL and Python skills,
• experience with Apache Kafka or other streaming technologies,
• experience with dbt and modern data transformation approaches,
• understanding of Medallion Architecture,
• experience with data quality, data contracts, lineage, observability and SLA/SLO monitoring,
• understanding of data governance and working with data in a regulated environment,
• strong problem-solving skills and the ability to work independently on complex, scalable solutions.