Remote Data Engineer: Snowflake Migrations & Airflow
AgileEngine, LLC.
A complete application in a minute — tailored resume and cover letter, ready to send.
Benefits offered by this job
Job summary
AgileEngine is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and to support reliable Airflow workflows. You will work embedded within the data engineering function, migrating roughly 1,000 datasets to Snowflake, adapting pipelines, and ensuring data quality throughout the process.
The role offers flextime with remote and office options and exciting projects with Fortune 500 and top product companies.
Qualifications
- 3+ years of hands-on Python development experience.
- Advanced SQL with complex joins, CTEs, window functions, and tuning.
- Snowflake data modeling proficiency.
- Apache Airflow experience for pipelines in Python.
- Experience with Iceberg and Parquet data formats.
- AWS experience, especially S3 for data lakes and lifecycle policies.
- Testing strategy experience with hands-on debugging.
- At least 2 years in industry with large-scale datasets, Airflow and Spark.
- Overlap until 12 PM Pacific Time.
Responsibilities
- Work embedded within the data engineering function, partnering closely with the data platform team to support a large-scale data platform modernization effort.
- Execute the migration of approximately 1,000 datasets to Snowflake.
- Adapt existing pipelines to Snowflake, following the core architecture and technical approach defined by the internal team.
- Ensure data quality and reliability throughout the migration process.
- Support workflow scheduling and monitoring in Apache Airflow 3.
- Execute time-sensitive migrations, including Airflow 2 to 3, Confluent region migration, and the move to Iceberg.
- Help accelerate the migration initiatives targeted for completion by the end of March 2027.
Skills
Tools
Job description
AgileEngine is seeking a Data Engineer to execute large-scale data platform migrations to Snowflake and to support reliable Airflow workflows. You will work embedded within the data engineering function, migrating roughly 1,000 datasets to Snowflake, adapting pipelines, and ensuring data quality throughout the process.
The role offers flextime with remote and office options and exciting projects with Fortune 500 and top product companies.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
