Remote Data Engineer — Snowflake Migrations & Airflow

AgileEngine, LLC.; Województwo pomorskie; Hybrid; PLN 355,000 - 512,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.

You will work within the data engineering function, migrate ~1,000 datasets, adapt pipelines to Snowflake, and ensure data quality. Experience with Airflow, Spark, Kafka, and AWS S3 is required, with a focus on large-scale datasets and English fluency. Flexible remote/office options available.

Qualifications

• 3+ years hands-on Python development.
• Advanced SQL with complex joins, CTEs, window functions, performance tuning.
• Snowflake data modeling.
• Apache Airflow: developing and testing pipelines in Airflow and Python.
• Apache Kafka.
• Apache Spark, including PySpark.
• Iceberg and Parquet data formats.
• AWS experience, especially S3 (data lakes, partitioning, lifecycle).
• Testing strategy experience with hands-on debugging and testing code.
• At least 2 years of industry experience with large-scale datasets, including Airflow and Spark.
• Overlap until 12 PM Pacific Time.
• Upper-intermediate English level.

Responsibilities

• Embed within the data engineering function to support a large-scale data platform modernization.
• Execute migration of ~1,000 datasets to Snowflake.
• Adapt pipelines to Snowflake following defined architecture.
• Ensure data quality and reliability during migration.
• Support workflow scheduling and monitoring in Airflow 3.
• Execute time-sensitive migrations including Airflow 2 to 3, Confluent region migration, and Iceberg move.
• Aim to complete migrations by end of March 2027.

Skills

Python development

Advanced SQL

Airflow

Snowflake modeling

Kafka

Spark / PySpark

Iceberg & Parquet

AWS S3

Testing strategy

Large-scale datasets

English level

Overlap until PT

Tools

Snowflake

Airflow

Spark

Parquet

Job description

AgileEngine is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.

You will work within the data engineering function, migrate ~1,000 datasets, adapt pipelines to Snowflake, and ensure data quality. Experience with Airflow, Spark, Kafka, and AWS S3 is required, with a focus on large-scale datasets and English fluency. Flexible remote/office options available.