Python Data Pipeline Engineer (Apache Airflow) - Remote Work

BairesDev; Salvador; Remote; BRL 551,000 - 752,000; Full time

Benefits offered by this job

Remote work 100%

USD or local currency pay

Hardware provided

Flexible hours

Paid parental leave

Vacations and holidays

Mentorship & growth

Job summary

BairesDev is seeking a Python Data Pipeline Engineer (Apache Airflow) to design and implement automated workflows, connecting raw data sources to analytics. You will create reliable data structures powering business intelligence and collaborate with engineers to align data delivery with business needs.

The role offers 100% remote work, compensation in USD or local currency, hardware and software setup for home, flexible hours, paid parental leave, vacations, and ongoing mentorship and growth

Qualifications

• 5+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in building, scheduling, and orchestrating data pipelines using Apache Airflow and Python.
• Strong proficiency in developing data integration workflows and ETL/ELT processes.
• Solid experience in optimizing data pipeline performance and troubleshooting complex workflows.
• Advanced proficiency in English.

Responsibilities

• Design, develop, and maintain complex data pipelines and workflow orchestration processes.
• Build efficient data transformation routines to handle large-scale datasets.
• Optimize pipeline performance and quickly resolve workflow bottlenecks or dependencies.
• Collaborate with engineering teams to align data delivery strategies with business needs.
• Establish best practices for pipeline monitoring, alerting, and automated scheduling.

Skills

Data engineering

Python

ETL/ELT

Pipeline optimization

English

Tools

Apache Airflow

Python

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Python Data Pipeline Engineer (Apache Airflow) at BairesDev

As a Python Data Pipeline Engineer specializing in Apache Airflow, you will design and implement automated workflows to ensure seamless data movement and integration. You will act as a key connector between raw data sources and actionable analytics, creating reliable data structures that power business intelligence.

What You'll Do:

• Design, develop, and maintain complex data pipelines and workflow orchestration processes.
• Build efficient data transformation routines to handle large-scale datasets.
• Optimize pipeline performance and quickly resolve workflow bottlenecks or dependencies.
• Collaborate with engineering teams to align data delivery strategies with business needs.
• Establish best practices for pipeline monitoring, alerting, and automated scheduling.

What we are looking for:

• 5+ years of experience in Data Engineering or Software Engineering.
• Proven expertise in building, scheduling, and orchestrating data pipelines using Apache Airflow and Python.
• Strong proficiency in developing data integration workflows and ETL/ELT processes.
• Solid experience in optimizing data pipeline performance and troubleshooting complex workflows.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.