Astronomer Airflow Architect

Signature IT World Inc

Woodbridge Township (NJ)

On-site

USD 100,000 - 130,000

Part time

14 days+

Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Job summary

A leading IT consulting firm is seeking a Solutions Architect specializing in Apache Airflow to deliver innovative cloud orchestration solutions. In this role, you will guide a team in implementing Airflow, optimize data pipelines, and collaborate across domains. The ideal candidate should have strong technical expertise in Airflow, Python, and Azure data architecture. This is a mid-senior level contract position based in Woodbridge Township, NJ.

Responsibilities

Guide technologists in their Apache Airflow journeys.
Review and optimize data ingestion and extraction pipelines.
Develop frameworks for managing pipelines.
Build architecture and operational diagrams.
Provide reference implementations for Airflow activities.
Keep up with latest features of Airflow.
Collaborate to build reusable assets and tools.
Interact with teams to channel product feedback.
Work with tech team to realize value in Airflow journeys.

Skills

Apache Airflow experience

ETL Design and Implementation

Python Proficiency

Azure data architecture knowledge

Technical leadership

Strong communication

Willingness to learn technologies

Workflow migration experience

Azure Data Factory integration

Snowflake experience

Container experience

SQL experience

Kubernetes experience

Enterprise data experience

Job description

Overview

Job Title: Astronomer Airflow Architect

Location: Iselin, NJ || Onsite

Contract: 10+ years

Job Description:

The Solutions Architect specializing in Cloud Orchestration, will work with a small group of technologists and become a trusted advisor delivering technical solutions leveraging Apache Airflow hosted on the Astronomer platform. In this role, he will engineer a wide range of use cases where, Apache Airflow sits at the center of the solution, with the goal of rapidly developing solutions for the use cases.

Responsibilities

Help guide a small group of technologists in their Apache Airflow journeys, including identifying new use cases and onboarding new domain teams.
Review, optimize, and tune data ingestion and extraction pipelines orchestrated by Airflow.
Development of frameworks to manage and engineer a large number of pipelines for the entire domain.
Build architecture, data flow, and operational diagrams and documents, with detailed physical and logical layers.
Provide reference implementations of various activities, including composing data pipelines in Airflow, implementing new Airflow features, or integrating Airflow with 3rd party solutions.
Keep up with the latest Astro and Airflow features, in order to better advise the technologies on impactful improvements they can make.
Collaborate to build reusable assets, automation tools, and documented best practices.
Interact with Domain and Engineering teams to channel product feedback and requirements discussions.
Work with technology team members to ensure that are realizing value in their Airflow and Astronomer journeys

Skills Required:

Experience with Apache Airflow in production environments.
Experience in designing and implementing ETL, Data Warehousing, and ML/AI use cases.
Proficiency in Python.
Knowledge of Azure cloud-native data architecture.
Demonstrated technical leadership on team projects.
Strong oral and written communication skills.
Willingness to learn new technologies and build reference implementations.
Experience in migrating workflows from legacy schedulers (Tidal) to Apache Airflow.
Experience in integrating with Azure Data Factory pipelines.
Snowflake and Data bricks experience.
Experience working with containers.
SQL experience.
Kubernetes experience, either on-premise or in the cloud.
Enterprise data experience in regulated environments.