Data Engineer — Snowflake Migrations & Airflow (Remote)

AgileEngine, LLC.; Alicante; Híbrido; EUR 107 000 - 142 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Professional growth

Competitive USD-based pay

Exciting projects

Flextime: remote or office options

Resumo da oferta

AgileEngine is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.

You will work within the data engineering function to modernize our data infrastructure, migrate datasets, and ensure data quality across the migration lifecycle. The role offers flextime with remote and office options and exposure to Fortune 500 projects.

Qualificações

• 3+ years of hands-on Python development.
• Advanced SQL with complex joins, CTEs, window functions, and performance tuning.
• Snowflake data modeling.
• Apache Airflow pipelines and testing.
• AWS S3 data lakes, partitioning and lifecycle policies.
• Testing strategy experience; hands-on debugging.
• 2+ years with large-scale datasets, Airflow and Spark.
• Overlap until 12 PM Pacific Time.

Responsabilidades

• Work embedded within the data engineering function, partnering with the data platform team on a large-scale modernization.
• Migrate ~1,000 datasets to Snowflake.
• Adapt existing pipelines to Snowflake following defined architecture.
• Ensure data quality and reliability during migration.
• Support workflow scheduling and monitoring in Airflow 3.
• Execute migrations including Airflow 2 to 3 and Iceberg move.

Conhecimentos

Python development

Advanced SQL

Snowflake modeling

Apache Airflow

Iceberg & Parquet

AWS S3

Testing strategy

Spark

Large-scale datasets

PT overlap availability

Ferramentas

Snowflake

Apache Airflow

Spark

Descrição da oferta de emprego

AgileEngine is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and support reliable Airflow workflows.

You will work within the data engineering function to modernize our data infrastructure, migrate datasets, and ensure data quality across the migration lifecycle. The role offers flextime with remote and office options and exposure to Fortune 500 projects.