Data Engineer

AgileEngine; Polska; Hybrid; PLN 469,000 - 704,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based compensation

Exciting projects with Fortune 500 and

Flextime

Job summary

AgileEngine is seeking a Data Engineer to lead large-scale migrations to Snowflake and ensure reliable Airflow workflows as part of a data platform modernization.

You will migrate ~1,000 datasets, adapt pipelines to Snowflake, and enforce data quality while coordinating Airflow 2→3 and Iceberg transitions. Strong Python, SQL, and AWS S3 skills are essential, with overlap until 12 PM PT.

Qualifications

• 3+ years of hands-on Python development experience.
• Advanced SQL with joins, CTEs, window functions and tuning.
• Snowflake data modeling.
• Apache Airflow—developing and testing pipelines.
• Iceberg and Parquet data formats.
• AWS (S3) data lakes, partitioning and lifecycle policies.
• Testing strategy experience with hands-on debugging.
• 2+ years of industry experience with large-scale Airflow/Spark.
• Overlap until 12 PM Pacific Time.

Responsibilities

• Execute large-scale data platform migrations to Snowflake.
• Support reliable Airflow workflows in ongoing modernization.
• Migrate ~1,000 datasets to Snowflake per plan.
• Adapt existing pipelines to Snowflake per internal architecture.
• Ensure data quality and reliability during migration.
• Monitor and schedule workflows in Airflow 3.
• Coordinate migrations including Airflow 2 to 3 and Iceberg move.
• Contribute to completion of migration initiatives by March 2027.

Skills

Python development

Advanced SQL

English (upper-intermediate)

Large-scale data experience

Data migrations

Snowflake modeling

Airflow

Kafka

Spark / PySpark

Iceberg

Parquet

AWS S3

Testing / debugging

Overlap until 12 PM PT

Tools

Snowflake

Apache Airflow

Iceberg

Parquet

AWS S3

Spark / PySpark

Kafka

Job description

We are looking for a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.

The mandatory requirements are 3+ years of Python, advanced SQL, Snowflake modeling, Airflow, Kafka, Spark/PySpark, Iceberg, Parquet, AWS S3, testing/debugging, 2+ years with large-scale Airflow/Spark data, overlap until 12 PM Pacific Time, and upper-intermediate English. Snowflake/Airflow migrations and AI tools are a plus.

What you will do

• Work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort.
• Execute the migration of approximately 1,000 datasets to Snowflake.
• Adapt existing pipelines to Snowflake, following the core architecture and technical approach defined by the internal team.
• Ensure data quality and reliability throughout the migration process.
• Support workflow scheduling and monitoring in Apache Airflow 3.
• Execute time-sensitive migrations, including Airflow 2 to 3, Confluent region migration, and the move to Iceberg.
• Help accelerate the migration initiatives targeted for completion by the end of March 2027.

Must haves

• Strong software engineering fundamentals.
• 3+ years of hands-on Python development experience.
• Advanced SQL, including complex joins, CTEs, window functions, and performance tuning.
• Snowflake data modeling.
• Apache Airflow — developing and testing pipelines in Airflow and Python.
• Iceberg and Parquet data formats.
• AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies).
• Testing strategy experience, with the ability to hands-on debug and test code.
• At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.
• Overlap until 12 PM Pacific Time.

Nice to haves

• Hands-on experience with Snowflake migrations (data warehouse modernization, performance and cost optimization).
• Experience with Apache Airflow migrations (version upgrades, executor changes, or platform migrations).

Perks and Benefits

• Professional growth

Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps

• Competitive compensation

We match your ever-growing skills, talent, and contributions with competitive USD-based compensation and budgets for education, fitness, and team activities

• A selection of exciting projects

Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands

• Flextime

Tailor your schedule for an optimal work-life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.