Data Engineer: Snowflake Migrations & Big Data Platform

AgileEngine, LLC.; Alicante; On-site; EUR 107,000 - 161,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine, LLC. is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows. The role emphasizes Python development, advanced SQL, Spark, and AWS S3 data lake experience.

You will migrate datasets, adapt pipelines, ensure data quality, and support Airflow scheduling while collaborating with the data platform team. Fluency in English is required.

Qualifications

• 3+ years of hands-on Python development.
• Advanced SQL with complex joins, CTEs, window funcs, performance tuning.
• Snowflake data modeling.
• Apache Airflow — pipelines in Airflow and Python.
• Apache Kafka.
• Apache Spark; PySpark experience.
• Iceberg & Parquet data formats.
• AWS experience with S3 (data lakes, partitioning, lifecycle).
• At least 2 years with large-scale datasets, including Airflow and Spark.
• Overlap until 12 PM Pacific Time.
• Upper-intermediate English level.

Responsibilities

• Work embedded within the data engineering function to support modernization.
• Migrate ~1,000 datasets to Snowflake.
• Adapt pipelines to Snowflake following internal architecture.
• Ensure data quality and reliability during migration.
• Support workflow scheduling/monitoring in Airflow 3.
• Execute time-sensitive migrations (Airflow 2→3, Confluent region, Iceberg).
• Help accelerate migration initiatives to finish by end of March 2027.

Skills

Python development

Advanced SQL

Apache Airflow

Apache Kafka

Apache Spark / PySpark

Iceberg & Parquet

AWS S3

Data testing

Large-scale datasets

English (oral/written)

Tools

Snowflake

Confluent

Iceberg

Parquet

Job description

AgileEngine, LLC. is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows. The role emphasizes Python development, advanced SQL, Spark, and AWS S3 data lake experience.

You will migrate datasets, adapt pipelines, ensure data quality, and support Airflow scheduling while collaborating with the data platform team. Fluency in English is required.