Remote Data Engineer - Snowflake Migrations & Airflow

AgileEngine, LLC.; Zaragoza; Hybrid; EUR 50,000 - 75,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine, LLC is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Apache Airflow workflows. You will work embedded within the data engineering function to migrate approximately 1,000 datasets, adapt pipelines to Snowflake, and ensure data quality during the transition.

The role requires 3+ years of Python development, advanced SQL, Snowflake data modeling, and experience with Spark, Kafka, Iceberg/Parquet, and AWS S3.

Qualifications

• 3+ years hands-on Python development experience.
• Advanced SQL with complex joins, CTEs, window functions, and performance tuning.
• Snowflake data modeling experience.
• Apache Airflow development and testing pipelines.
• Kafka and Spark experience, including PySpark.
• Experience with Iceberg and Parquet data formats.
• AWS S3 data lake experience.
• Testing strategy experience and debugging.
• Minimum 2 years of industry experience with large-scale datasets and Airflow/Spark.
• Overlap until 12 PM Pacific Time.
• Upper-intermediate English level.

Responsibilities

• Work embedded within the data engineering function to support modernization.
• Migrate approximately 1,000 datasets to Snowflake.
• Adapt existing pipelines to Snowflake per internal architecture.
• Ensure data quality and reliability during migration.
• Support workflow scheduling in Airflow.
• Execute migrations including Airflow 2 to 3 and Iceberg move.
• Help accelerate modernization by March 2027.

Skills

Python development

Advanced SQL

Snowflake data modeling

Apache Airflow

Apache Kafka

Apache Spark

PySpark

Iceberg/Parquet

AWS S3

Data quality testing

Large-scale datasets

Time-zone coordination

English communication

Tools

Snowflake

Airflow

Kafka

Spark

Iceberg/Parquet

AWS S3

Job description

AgileEngine, LLC is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Apache Airflow workflows. You will work embedded within the data engineering function to migrate approximately 1,000 datasets, adapt pipelines to Snowflake, and ensure data quality during the transition.

The role requires 3+ years of Python development, advanced SQL, Snowflake data modeling, and experience with Spark, Kafka, Iceberg/Parquet, and AWS S3.