Data Engineer — Snowflake Migrations & Airflow Specialist

AgileEngine; Polska; Ibrido; PLN 469.000 - 704.000; Tempo pieno

Vantaggi offerti da questo lavoro

Professional growth

Competitive USD-based compensation

Exciting projects with Fortune 500 and

Flextime

Descrizione del lavoro

AgileEngine is seeking a Data Engineer to lead large-scale migrations to Snowflake and ensure reliable Airflow workflows as part of a data platform modernization.

You will migrate ~1,000 datasets, adapt pipelines to Snowflake, and enforce data quality while coordinating Airflow 2→3 and Iceberg transitions. Strong Python, SQL, and AWS S3 skills are essential, with overlap until 12 PM PT.

Competenze

• 3+ years of hands-on Python development experience.
• Advanced SQL with joins, CTEs, window functions and tuning.
• Snowflake data modeling.
• Apache Airflow—developing and testing pipelines.
• Iceberg and Parquet data formats.
• AWS (S3) data lakes, partitioning and lifecycle policies.
• Testing strategy experience with hands-on debugging.
• 2+ years of industry experience with large-scale Airflow/Spark.
• Overlap until 12 PM Pacific Time.

Mansioni

• Execute large-scale data platform migrations to Snowflake.
• Support reliable Airflow workflows in ongoing modernization.
• Migrate ~1,000 datasets to Snowflake per plan.
• Adapt existing pipelines to Snowflake per internal architecture.
• Ensure data quality and reliability during migration.
• Monitor and schedule workflows in Airflow 3.
• Coordinate migrations including Airflow 2 to 3 and Iceberg move.
• Contribute to completion of migration initiatives by March 2027.

Conoscenze

Python development

Advanced SQL

English (upper-intermediate)

Large-scale data experience

Data migrations

Snowflake modeling

Airflow

Kafka

Spark / PySpark

Iceberg

Parquet

AWS S3

Testing / debugging

Overlap until 12 PM PT

Strumenti

Snowflake

Apache Airflow

Iceberg

Parquet

AWS S3

Spark / PySpark

Kafka

Descrizione del lavoro

AgileEngine is seeking a Data Engineer to lead large-scale migrations to Snowflake and ensure reliable Airflow workflows as part of a data platform modernization.

You will migrate ~1,000 datasets, adapt pipelines to Snowflake, and enforce data quality while coordinating Airflow 2→3 and Iceberg transitions. Strong Python, SQL, and AWS S3 skills are essential, with overlap until 12 PM PT.