Senior Data Engineer Python, Apache Airflow, Snowflake, SQL Gdańsk

Diverse Consulting Group

Gdańsk

On-site

PLN 200,000 - 260,000

Full time

27 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Private medical care
Co-financing for the sports card
Constant support of dedicated consult­
Consultant

Job summary

Diverse Consulting Group is seeking an experienced Data Engineer to migrate 100+ legacy ETL pipelines to an Airflow-on-Kubernetes platform and to design scalable data ingestion pipelines. You will ensure pipelines are reliable, observable, and maintainable while collaborating with cross-functional teams.

You will develop Snowflake transformations with DBT and Python, contribute to CI/CD and data-quality practices, and help shape the technical direction of the data platform.

Qualifications

  • Strong hands-on experience with Python.
  • Experience with Airflow or similar orchestration tools.
  • Proven ETL and data pipeline development experience.
  • Practical experience with Git and standard version-control workflows.
  • Working knowledge of Snowflake or another major cloud data warehouse.
  • Understanding of data modeling fundamentals, including dimensional modeling, partitioning, and incremental load strategies.
  • Ability to work effectively in a large, cross-team environment with multiple stakeholders and dependencies.
  • Very good command of English, both spoken and written.

Responsibilities

  • Migrate 100+ legacy ETL pipelines across multiple source systems to an Airflow-on-Kubernetes orchestration platform.
  • Design, build, and maintain scalable data ingestion pipelines.
  • Ensure data pipelines are reliable, observable, and operationally maintainable.
  • Collaborate with source-system teams and stakeholders to onboard new financial data feeds.
  • Maintain and support existing data pipelines and integrations.
  • Develop the Snowflake transformation layer using DBT and Python-based data modeling.
  • Contribute to CI/CD, testing, and data-quality practices.
  • Contribute to the technical direction and ongoing development of the data platform.

Skills

Python programming
ETL development
Data modeling
CI/CD collaboration
Cross-team collaboration
English communication
Data pipeline design

Tools

Python
Apache Airflow
Git
Snowflake
DBT
GitHub Copilot
Kafka
Scala
Spark
Snowpark
Jenkins
DataStage
Informatica

Job description

As a recruitment company, DCG understands that every business is powered by experienced professionals. Our management style and partnership approach enable us to meet your needs and provide continuous support. Due to our ongoing growth and the large number of recruitment projects we undertake for our partners, we are currently looking for:

Responsibilities:

  • Migrate 100+ legacy ETL pipelines across multiple source systems to an Airflow-on-Kubernetes orchestration platform
  • Design, build, and maintain scalable data ingestion pipelines
  • Ensure data pipelines are reliable, observable, and operationally maintainable
  • Collaborate with source-system teams and stakeholders to onboard new financial data feeds
  • Maintain and support existing data pipelines and integrations
  • Develop the Snowflake transformation layer using DBT and Python-based data modeling
  • Contribute to CI/CD, testing, and data-quality practices
  • Contribute to the technical direction and ongoing development of the data platform

Requirements:

  • Strong hands‑on experience with Python
  • Solid experience with Apache Airflow or similar orchestration tools
  • Proven ETL and data pipeline development experience
  • Practical experience with Git and standard version‑control workflows
  • Working knowledge of Snowflake or another major cloud data warehouse
  • Understanding of data modeling fundamentals, including dimensional modeling, partitioning, and incremental load strategies
  • Ability to work effectively in a large, cross‑team environment with multiple stakeholders and dependencies
  • Very good command of English, both spoken and written
Nice to have:
  • Experience with DBT (Data Build Tool)
  • Familiarity with AI coding assistants such as GitHub Copilot for development, testing, and documentation
  • Experience with financial or banking data, including credit risk or regulatory reporting
  • Exposure to Scala, Spark, or Snowpark
  • Experience with Kafka or other streaming/messaging platforms
  • Familiarity with CI/CD tooling such as Jenkins and data‑quality/testing frameworks
  • Experience with legacy‑to‑modern ETL migrations, including DataStage or Informatica to Airflow/dbt‑style stacks

Offer:

  • Private medical care
  • Co‑financing for the sports card
  • Constant support of dedicated consultant

Personal Consulting Agency (License No. 4642)

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer Python, Apache Airflow, Snowflake, SQL Gdańsk
Senior Data Engineer Python, Apache Airflow, Snowflake, SQL Gdańsk

Diverse Consulting Group • Województwo pomorskie

On-site
PLN 200,000 - 280,000
Private medical care
Co-financing for the sports card
Constant support of dedicatedconsult
Senior Data Engineer
Senior Data Engineer

DCG • Województwo pomorskie

Hybrid
PLN 193,000 - 207,000
Private medical care
Senior Data Engineer
Senior Data Engineer

Solid Company • Województwo pomorskie

On-site
PLN 180,000 - 300,000
Prywatna opieka medyczna
Dofinansowanie karty sportowej
Stałe wsparcie dedykowanego konsultant
+1
Senior Data Engineer (DevOps) SSIS, Snowflake, SQL, Python, Apache Airflow Warsaw, Gdańsk
Senior Data Engineer (DevOps) SSIS, Snowflake, SQL, Python, Apache Airflow Warsaw, Gdańsk

DCG (Poland) • Warszawa

On-site
PLN 80,000 - 120,000
Private medical care
Co-financing for the sports card
Constant support of dedicated consultant
Senior Data Engineer (DevOps) SSIS, Snowflake, SQL, Python, Apache Airflow Warsaw, Gdańsk
Senior Data Engineer (DevOps) SSIS, Snowflake, SQL, Python, Apache Airflow Warsaw, Gdańsk

Diverse CG Sp. z o.o. Sp.k. • Warszawa

On-site
PLN 100,000 - 140,000
Private medical care
Co‑financing for the sports card
Constant support of dedicated consultant
Senior Data Engineer
Senior Data Engineer

Diverse Consulting Group • Gdańsk

On-site
PLN 180,000 - 260,000
Private medical care
Co-financing for the sports card
Dedicated consultant support
Senior Data Engineer
Senior Data Engineer

emagine Group • Województwo pomorskie

Hybrid
PLN 193,000 - 234,000
Senior Data Engineer Apache Hadoop, Apache Spark, SQL, Kafka Gdańsk
Senior Data Engineer Apache Hadoop, Apache Spark, SQL, Kafka Gdańsk

Diverse CG Sp. z o.o. Sp.k. • Województwo pomorskie

On-site
PLN 50,000 - 70,000
Private medical care
Co-financing for the sports card
Constant support of dedicated consultant
Senior Data Engineer Apache Hadoop, Apache Spark, SQL, Kafka Gdańsk
Senior Data Engineer Apache Hadoop, Apache Spark, SQL, Kafka Gdańsk

DCG (Poland) • Województwo pomorskie

On-site
PLN 89,280 - 167,400
Private medical care
Co-financing for the sports card
Constant support of dedicated consultant
Data Engineer
Data Engineer

Ework Group • Gdańsk

On-site
PLN 180,000 - 320,000
B2B agreement
Transparent working conditions
Possibility to work in an国际环境
+1
Top locations