Data Engineer – Snowflake Migrations on AWS

AgileEngine, LLC.; Málaga; Hybrid; EUR 98,000 - 143,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine, LLC. in Málaga is seeking a Data Engineer to execute large-scale data migrations to Snowflake and support reliable Airflow workflows.

You will work within the data engineering function to migrate approximately 1,000 datasets, adapt pipelines to Snowflake, ensure data quality, and monitor Airflow-based pipelines while collaborating with the data platform team on the modernization effort. This role offers flexible remote/office options and competitive USD compensation.

Qualifications

• 3+ years of hands-on Python development experience.
• Advanced SQL with complex joins, CTEs, window functions, and performance tuning.
• Snowflake data modeling.
• Apache Airflow—developing and testing pipelines in Airflow and Python.
• Iceberg and Parquet data formats.
• AWS experience, particularly S3 (data lakes, partitioning, and lifecycle policies).
• Testing strategy experience with hands-on debugging and testing code.
• At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.
• Overlap until 12 PM Pacific Time.

Responsibilities

• Support a large-scale data platform modernization by working with the data platform team.
• Migrate approximately 1,000 datasets to Snowflake.
• Adapt existing pipelines to Snowflake following defined architecture.
• Ensure data quality and reliability throughout migration.
• Support workflow scheduling and monitoring in Apache Airflow 3.

Skills

Python development

Advanced SQL

Airflow

Spark experience

Data quality testing

Tools

Snowflake

Airflow

Iceberg

Parquet

AWS S3

Job description

AgileEngine, LLC. in Málaga is seeking a Data Engineer to execute large-scale data migrations to Snowflake and support reliable Airflow workflows.

You will work within the data engineering function to migrate approximately 1,000 datasets, adapt pipelines to Snowflake, ensure data quality, and monitor Airflow-based pipelines while collaborating with the data platform team on the modernization effort. This role offers flexible remote/office options and competitive USD compensation.