Airflow Platform Administrator

Value Innovation Labs; Hyderabad, Pune District; Hybrid; INR 1,800,000 - 2,800,000; Full time

Job summary

Value Innovation Labs is seeking an Airflow Platform Administrator / Backend Engineer to manage Apache Airflow environments, including deployment, configuration, monitoring, and troubleshooting in a scalable, secure, and highly available setup.

The role emphasizes RBAC, multi-tenant management, and planned upgrades to Airflow 3.x, with Celery/Kubernetes Executors and Cloud Composer integration. Collaboration with DevOps and engineering teams is essential.

Qualifications

• Experience administering Apache Airflow and managing multi-tenant environments.
• Experience with GCP Cloud Composer and cloud-based Airflow deployments.
• Ability to plan upgrades and migrations for Airflow 3.x.
• Skills in monitoring, troubleshooting, and performance tuning of Airflow environments.
• Implement high-availability and security best practices.
• Collaborate with DevOps and engineering teams on platform requirements.

Responsibilities

• Administer, deploy, configure, monitor, and troubleshoot Apache Airflow environments.
• Manage Airflow RBAC, user access controls, and multi-tenant environments.
• Plan and execute Airflow 3.x upgrades, migrations, and platform enhancements.
• Configure and manage Celery Executor and Kubernetes Executor.
• Perform platform performance tuning, scalability, and reliability optimization.
• Implement high-availability and security best practices.
• Monitor Airflow platform health and troubleshoot production issues.
• Support cloud-native orchestration platforms, including GCP Cloud Composer.
• Collaborate with engineering, DevOps, and business teams on platform requirements and issues.
• Maintain operational documentation and support processes.
• Participate in incident management, root‑cause analysis, and production support.

Skills

Apache Airflow

GCP Cloud Composer

Airflow Administration

Airflow Deployment

Airflow Monitoring

Airflow Troubleshooting

Airflow RBAC

User Access Management

Multi-Tenant Airflow

Airflow 3.x Upgrade

Celery Executor

Kubernetes Executor

Job description

Job Description Airflow Platform Administrator / Backend Engineer

Location: Hyderabad, Pune Experience: 410 Years

Role Overview

We are looking for an Airflow Platform Administrator / Backend Engineer with strong hands‑on experience in Apache Airflow administration, deployment, configuration, monitoring, and troubleshooting. The role will focus on managing scalable, secure, and highly available Airflow environments.

Key Responsibilities

• Administer, deploy, configure, monitor, and troubleshoot Apache Airflow environments.
• Manage Airflow RBAC, user access controls, and multi‑tenant environments.
• Plan and execute Airflow 3.x upgrades, migrations, and platform enhancements.
• Configure and manage Celery Executor and Kubernetes Executor.
• Perform platform performance tuning, scalability, and reliability optimization.
• Implement high‑availability and security best practices.
• Monitor Airflow platform health and troubleshoot production issues.
• Support cloud‑native orchestration platforms, including GCP Cloud Composer.
• Collaborate with engineering, DevOps, and business teams on platform requirements and issues.
• Maintain operational documentation and support processes.
• Participate in incident management, root‑cause analysis, and production support.

Mandatory Skills

• Apache Airflow
• GCP Cloud Composer
• Airflow Administration
• Airflow Deployment & Configuration
• Airflow Monitoring & Troubleshooting
• Airflow RBAC
• User Access Management
• Multi‑Tenant Airflow
• Airflow 3.x Upgrade & Migration
• Celery Executor
• Kubernetes Executor