Python Airflow Developer

Airo Digital Labs, LLC; Mumbai; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Airo Digital Labs in Mumbai, India, is seeking a data engineer to design and develop Airflow-based workflows and robust data pipelines that automate complex data tasks.

You will apply Python, SQL and data warehouse concepts to ingest data from diverse sources, optimize performance, ensure data quality, and collaborate with cross-functional teams to deliver insights.

This role offers hands-on learning, strong collaboration, and opportunities to impact real business decisions.

Qualifications

• Strong background in Python programming.
• Experience with Airflow for orchestrating workflows.
• Understanding of data warehouse concepts and ETL tools.
• Good understanding of database systems and data architecture.
• Experience working in a SQL environment.
• Proficiency with version control systems (e.g., Git).
• Excellent communication and collaboration skills.

Responsibilities

• Design and develop Airflow DAGs to automate workflows.
• Configure and manage task dependencies, scheduling, retries, and error handling within Airflow.
• Integrate Airflow with diverse data sources, processing systems, and storage solutions (e.g., databases, cloud services, data lakes).
• Develop efficient workflows for data ingestion, processing, and visualization.
• Build, maintain, monitor, and orchestrate data pipelines.
• Collaborate with cross-functional teams to understand business requirements and design solutions.
• Provide technical support to team members and resolve technical issues.
• Ensure the high performance of data retrieval processes.
• Debug and troubleshoot applications to ensure high-quality operations.
• Stay current with the latest technology trends and advancements.

Skills

Python

Airflow

Data warehouse concepts

Database knowledge

SQL

Communication and collaboration

Tools

Git

Job description

Join Airo Digital Labs and build your career with a leader in emerging digital technologies such as robotic process automation, conversational AI, machine learning, the internet of things, voice-based technologies, and cloud enablement. At Airo, we offer you competitive benefits and compensation packages along with the opportunity to learn on the job, develop knowledge of the process, and grow your career. What’s more, you will have fun as you solve some of the most complex business problems.

Key Responsibilities:

• Design and Develop Airflow DAGs: Create and maintain Airflow DAGs to automate workflows, including ETL processes.
• Task Management: Configure and manage task dependencies, scheduling, retries, and error handling within Airflow.
• Integration: Integrate Airflow with diverse data sources, processing systems, and storage solutions (e.g., databases, cloud services, data lakes).
• Workflow Optimization: Develop efficient workflows for data ingestion, processing, and visualization.
• Data Pipeline Management: Build, maintain, monitor, and orchestrate data pipelines.
• Collaboration: Collaborate with cross-functional teams to understand business requirements and design solutions.
• Technical Support: Provide technical support to team members and resolve technical issues.
• Performance Optimization: Ensure the high performance of data retrieval processes.
• Debugging and Troubleshooting: Debug and troubleshoot applications to ensure high-quality operations.
• Staying Updated: Stay current with the latest technology trends and advancements.

Required Skills:

• Python Proficiency: Strong background in Python programming.
• Airflow Expertise: Experience with Airflow for orchestrating workflows.
• Data Warehouse Concepts: Understanding of data warehouse concepts and ETL tools.
• Database Knowledge: Good understanding of database systems and data architecture.
• SQL Proficiency: Experience working in a SQL environment.
• Version Control: Proficiency with version control systems (e.g., Git).
• Communication and Collaboration: Excellent communication and collaboration skills.

Years of Experience

5Yrs Years to 8 Yrs