Airflow Engineer: Data Pipelines & GCP Expert

Red 11; United Kingdom; Remote; GBP 70,000 - 110,000; Full time

Job summary

Red 11 is seeking a Python-focused data engineering specialist in the UK to design scalable data pipelines and reusable code. You'll leverage Airflow, Pandas, and SQLAlchemy, with hands-on GCP experience (BigQuery, Cloud Storage) and GitHub workflows to ensure reliable, production-grade deployments.

Attention to debugging, scheduling, and observability with logging to GCS, plus collaboration across teams to optimize pipelines.

Qualifications

• Strong Python scripting for data engineering tasks.
• Expertise with Apache Airflow and DAG orchestration.
• Experience with GitHub workflows and CI/CD.
• Hands-on with Google Cloud Platform services.

Responsibilities

• Design and implement Python data pipelines for data engineering tasks.
• Build and maintain Airflow DAGs, operators, and sensors.
• Debug production issues and optimize scheduling and logging.
• Collaborate with teams using GCP services like BigQuery and Cloud Storage.

Skills

Python

Pandas

Requests

SQLAlchemy

Tools

Apache Airflow

GitHub

GCP

Job description

Red 11 is seeking a Python-focused data engineering specialist in the UK to design scalable data pipelines and reusable code. You'll leverage Airflow, Pandas, and SQLAlchemy, with hands-on GCP experience (BigQuery, Cloud Storage) and GitHub workflows to ensure reliable, production-grade deployments.

Attention to debugging, scheduling, and observability with logging to GCS, plus collaboration across teams to optimize pipelines.