Data Engineer: Snowflake Migrations & Airflow Expert
AgileEngine, LLC.
Stand out for this role — generate a tailored resume and cover letter in about a minute.
Benefits offered by this job
Job summary
AgileEngine, LLC. is seeking a Data Engineer to execute large-scale data migrations to Snowflake and support Airflow workflows, within a people-first culture.
You will join a team delivering modernization across 1,000 datasets, adapting pipelines to Snowflake, ensuring data quality, and coordinating with remote and on-site colleagues. This role offers flexible Flextime and opportunities with Fortune 500 and growing startups.
Qualifications
- 3+ years of hands-on Python development experience.
- Advanced SQL with complex joins, CTEs, window functions and tuning.
- Snowflake data modeling proficiency.
- Apache Airflow development and testing in Python.
- Experience with Iceberg and Parquet formats.
- AWS S3 data lakes, partitioning, lifecycle policies.
- 2+ years in industry handling large-scale datasets including Airflow and Spark.
- Timezone overlap until 12 PM Pacific Time.
Responsibilities
- Work with data platform team on a data platform modernization.
- Migrate approximately 1,000 datasets to Snowflake.
- Adapt existing pipelines to Snowflake following internal architecture.
- Ensure data quality and reliability during migration.
- Support workflow scheduling and monitoring in Apache Airflow 3.
- Execute time-sensitive migrations (Airflow 2→3, Confluent region, Iceberg).
- Help accelerate migration initiatives through March 2027.
Skills
Tools
Job description
AgileEngine, LLC. is seeking a Data Engineer to execute large-scale data migrations to Snowflake and support Airflow workflows, within a people-first culture.
You will join a team delivering modernization across 1,000 datasets, adapting pipelines to Snowflake, ensuring data quality, and coordinating with remote and on-site colleagues. This role offers flexible Flextime and opportunities with Fortune 500 and growing startups.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
