Data Engineer: Snowflake Migrations & Airflow Pipelines

AgileEngine, LLC.; Madrid; Hybrid; EUR 63,000 - 99,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine, an Inc. 5000 company, is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.

You’ll work within the data engineering function on a modernization effort, migrating datasets, adapting pipelines to Snowflake, ensuring data quality, and supporting Airflow operations. Strong Python, SQL, Spark, and AWS skills are required.

Qualifications

• 3+ years of hands-on Python development experience.
• Advanced SQL, including complex joins, CTEs, window functions, and performance tuning.
• Snowflake data modeling.
• Apache Airflow — developing and testing pipelines in Airflow and Python.
• Apache Kafka.
• Apache Spark, including hands-on PySpark experience.
• Iceberg and Parquet data formats.
• AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies).
• At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.
• Overlap until 12 PM Pacific Time.
• Upper-intermediate English level.

Responsibilities

• Execute the migration of data pipelines to Snowflake and adapt existing pipelines to Snowflake architecture.
• Support scheduling and monitoring in Apache Airflow.
• Ensure data quality and reliability during migration.
• Collaborate with data platform team on large-scale modernization efforts.
• Complete migrations and work toward March 2027 completion.

Skills

Python

SQL

Airflow

PySpark

Tools

Snowflake

Kafka

Spark (PySpark)

Iceberg

Parquet

AWS S3

Job description

AgileEngine, an Inc. 5000 company, is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.

You’ll work within the data engineering function on a modernization effort, migrating datasets, adapting pipelines to Snowflake, ensuring data quality, and supporting Airflow operations. Strong Python, SQL, Spark, and AWS skills are required.