Data Engineer: AWS, Snowflake & Airflow | Flexible Remote

AgileEngine, LLC.; Barcelona; Hybrid; EUR 107,000 - 161,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime

Job summary

AgileEngine, LLC in Barcelona seeks a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows. You will partner with the data platform team to migrate datasets, adapt pipelines, and ensure data quality and timeliness.

Join Fortune 500 and top product clients on modern data solutions with flexi-time and remote/office options, contributing to a major modernization effort targeting completion by March 2027.

Qualifications

• 3+ years of hands-on Python development experience.
• Advanced SQL, including complex joins, CTEs, window functions, and performance tuning.
• Snowflake data modeling experience.
• Apache Airflow development and testing pipelines in Python.
• Experience with Iceberg and Parquet data formats.
• AWS experience, particularly S3, for data lakes, partitioning, and lifecycle policies.
• Testing strategy experience with hands-on debugging and testing code.
• At least 2 years of industry experience working with large-scale datasets, including Airflow and Spark.
• Overlap until 12 PM Pacific Time.

Responsibilities

• Work embedded within the data engineering function to support a large-scale data platform modernization.
• Execute the migration of approximately 1,000 datasets to Snowflake.
• Adapt existing pipelines to Snowflake following internal architecture.
• Ensure data quality and reliability throughout migration.
• Support workflow scheduling and monitoring in Apache Airflow 3.
• Execute time-sensitive migrations, including Airflow 2 to 3 upgrades.
• Move to Iceberg and Confluent region migrations.
• Help accelerate migration initiatives targeted for completion by end of March 2027.

Skills

Python development

Advanced SQL

Snowflake data modeling

Apache Airflow

Iceberg data formats

Parquet data formats

AWS S3

Testing and debugging

Large-scale data experience

Timezone overlap

Tools

Airflow

Spark

Snowflake

Job description

AgileEngine, LLC in Barcelona seeks a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows. You will partner with the data platform team to migrate datasets, adapt pipelines, and ensure data quality and timeliness.

Join Fortune 500 and top product clients on modern data solutions with flexi-time and remote/office options, contributing to a major modernization effort targeting completion by March 2027.