Data Engineer: Snowflake Migrations & Airflow (Remote)

AgileEngine, LLC.; Alicante; Hybrid; EUR 134,000 - 170,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based pay

Exciting projects with Fortune 500

Flextime - remote & office options

Job summary

AgileEngine, a fast-growing data engineering team, is seeking a Data Engineer to drive large-scale migrations to Snowflake and sustain reliable Airflow workflows. The role focuses on modernizing data platforms, migrating roughly 1,000 datasets, and adapting pipelines to Snowflake with an emphasis on data quality.

You will collaborate with the data platform team, handle complex data formats like Iceberg and Parquet, and work across AWS S3 data lakes.

Qualifications

• Strong software engineering fundamentals and production-grade coding discipline.
• 3+ years of hands-on Python development experience.
• Advanced SQL skills with complex joins, CTEs, windows, and performance tuning.
• Snowflake data modeling expertise.
• Experience building and testing pipelines with Apache Airflow.
• Familiarity with Iceberg and Parquet data formats.
• AWS experience, especially S3 for data lakes and lifecycle policies.
• Solid testing strategy and debugging skills.
• At least 2 years handling large-scale datasets with Airflow and Spark.
• Ability to overlap work hours until 12 PM Pacific Time.

Responsibilities

• Work within the data engineering function to support modernization and migrations.
• Migrate approximately 1,000 datasets to Snowflake.
• Adapt existing pipelines to Snowflake following internal architecture.
• Ensure data quality and reliability during migration.
• Support workflow scheduling and monitoring in Airflow.
• Execute time-sensitive migrations, including Airflow 2→3 and Iceberg moves.
• Help accelerate migration initiatives toward the March 2027 deadline.

Skills

Strong software engineering

Python development

Advanced SQL

Snowflake modeling

Apache Airflow

Iceberg data formats

Parquet data formats

AWS S3

Testing strategy

Large-scale datasets

Timezone overlap (PT)

Tools

Snowflake

Apache Airflow

Spark

Iceberg

Parquet

AWS S3

Job description

AgileEngine, a fast-growing data engineering team, is seeking a Data Engineer to drive large-scale migrations to Snowflake and sustain reliable Airflow workflows. The role focuses on modernizing data platforms, migrating roughly 1,000 datasets, and adapting pipelines to Snowflake with an emphasis on data quality.

You will collaborate with the data platform team, handle complex data formats like Iceberg and Parquet, and work across AWS S3 data lakes.