Python Airflow Developer

United States Digital Space LLC; Maharashtra; On-site; INR 1,200,000 - 1,700,000; Full time

Job summary

Airo is seeking a skilled data engineer to design and implement Airflow DAGs, manage ETL pipelines, and optimize data workflows in a fast-paced environment.

The role requires strong Python, Airflow, SQL, and data warehousing knowledge, with a focus on collaboration with cross-functional teams to deliver reliable data solutions. Join us to contribute to cutting-edge digital technologies and drive impactful data initiatives.

Qualifications

• 5–8 years of experience in data engineering or ETL roles.
• Proficient in Python and Airflow for workflow orchestration.
• Strong knowledge of data warehouses and ETL concepts.
• Experience with SQL databases and data architecture.
• Familiarity with Git or other version control systems.
• Excellent communication and collaboration skills.

Responsibilities

• Design and Develop Airflow DAGs to automate workflows and ETL processes.
• Configure and manage task dependencies, scheduling, retries, and error handling in Airflow.
• Integrate Airflow with diverse data sources and storage solutions (databases, cloud services, data lakes).
• Develop efficient workflows for data ingestion, processing, and visualization.
• Build, monitor, and orchestrate data pipelines.
• Collaborate with cross-functional teams to understand business requirements and design solutions.
• Provide technical support to team members and resolve issues.
• Ensure high performance of data retrieval processes.
• Debug and troubleshoot applications to ensure smooth operations.
• Stay updated with latest technology trends and advancements.

Skills

Python

Airflow

Data Warehousing

SQL

Git

Communication

Collaboration

Tools

Git

Job description

##### Key Job Details

Level : Employment type : Full Time

About the job

Join the company and build your career with a leader in emerging digital technologies such as robotic process automation, conversational AI, machine learning, the internet of things, voice-based technologies, and cloud enablement. At Airo, we offer you competitive benefits and compensation packages along with the opportunity to learn on the job, develop knowledge of the process, and grow your career. What’s more, you will have fun as you solve some of the most complex business problems.

Key Responsibilities:

• Design and Develop Airflow DAGs: Create and maintain Airflow DAGs to automate workflows, including ETL processes.
• Task Management: Configure and manage task dependencies, scheduling, retries, and error handling within Airflow.
• Integration: Integrate Airflow with diverse data sources, processing systems, and storage solutions (e.g., databases, cloud services, data lakes).
• Workflow Optimization: Develop efficient workflows for data ingestion, processing, and visualization.
• Data Pipeline Management: Build, maintain, monitor, and orchestrate data pipelines.
• Collaboration: Collaborate with cross-functional teams to understand business requirements and design solutions.
• Technical Support: Provide technical support to team members and resolve technical issues.
• Performance Optimization: Ensure the high performance of data retrieval processes.
• Debugging and Troubleshooting: Debug and troubleshoot applications to ensure high-quality operations.
• Staying Updated: Stay current with the latest technology trends and advancements.

Required Skills:

• Python Proficiency: Strong background in Python programming.
• Airflow Expertise: Experience with Airflow for orchestrating workflows.
• Data Warehouse Concepts: Understanding of data warehouse concepts and ETL tools.
• Database Knowledge: Good understanding of database systems and data architecture.
• SQL Proficiency: Experience working in a SQL environment.
• Version Control: Proficiency with version control systems (e.g., Git).
• Communication and Collaboration: Excellent communication and collaboration skills.

Years of Experience

• 5Yrs Years to 8 Yrs