Data Engineer for Snowflake Migrations & Airflow

AgileEngine, LLC.; Lublin; Hybrid; PLN 469,000 - 704,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Apache Airflow workflows. You will collaborate within the data engineering function to advance a major modernization initiative.

You'll migrate about 1,000 datasets to Snowflake, adapt pipelines to the new platform, and ensure data quality and reliability. This role offers flexible remote/office options and projects with Fortune 500 clients.

Qualifications

• 3+ years of hands-on Python development experience.
• Advanced SQL with complex joins, CTEs, window functions, and performance tuning.
• Experience with Snowflake data modeling.
• Apache Airflow — developing and testing pipelines in Airflow and Python.
• Iceberg and Parquet data formats.
• AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies).
• At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.
• Overlap until 12 PM Pacific Time.

Responsibilities

• Work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort.
• Execute the migration of approximately 1,000 datasets to Snowflake.
• Adapt existing pipelines to Snowflake, following the core architecture and technical approach defined by the internal team.
• Ensure data quality and reliability throughout the migration process.
• Support workflow scheduling and monitoring in Apache Airflow 3.
• Execute time-sensitive migrations, including Airflow 2 to 3, Confluent region migration, and the move to Iceberg.
• Help accelerate the migration initiatives targeted for completion by the end of March 2027.

Skills

Python

Advanced SQL

Testing

Airflow pipelines

Large-scale datasets

Pacific Time overlap

Tools

Snowflake

Apache Airflow

Iceberg

Parquet

AWS S3

Spark

Job description

AgileEngine is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Apache Airflow workflows. You will collaborate within the data engineering function to advance a major modernization initiative.

You'll migrate about 1,000 datasets to Snowflake, adapt pipelines to the new platform, and ensure data quality and reliability. This role offers flexible remote/office options and projects with Fortune 500 clients.