Senior Data Engineer (GCP, Python) - Remote Work

BairesDev; Stati Uniti; Remoto; CLP 137.525.000 - 186.640.000; Tempo pieno

Descrizione del lavoro

BairesDev is seeking a Senior Data Engineer (GCP, Python) to design, build, and optimize large-scale data pipelines for analytics. You will drive streaming and batch data processing, ensuring data availability across a modern cloud environment.

In this role you will architect scalable ETL/ELT workflows, collaborate with product and engineering teams, and ensure data quality and reliability. 5+ years of experience and strong English proficiency are required.

Competenze

• 5+ years of experience in Data Engineering or related field.
• Proficient in Python with hands-on experience on GCP services (BigQuery, Dataflow, Pub/Sub).
• Experience designing streaming pipelines and robust ETL/ELT workflows.
• Strong understanding of workflow orchestration (Airflow/Cloud Composer) and analytics-focused data modeling.
• Excellent English proficiency.

Mansioni

• Design, implement, and maintain scalable batch and streaming data pipelines.
• Architect ETL/ELT workflows using cloud-native services and orchestrators.
• Develop and optimize data models for downstream analytics.
• Collaborate with product and engineering teams to integrate diverse datasets and ensure data quality.
• Monitor and optimize pipeline performance for efficiency and reliability.

Conoscenze

Python

GCP

BigQuery

Dataflow

Pub/Sub

Airflow

Cloud Composer

Data modeling

Strumenti

Apache Airflow

Descrizione del lavoro

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

Senior Data Engineer (GCP, Python) at BairesDev

As a Senior Data Engineer (GCP, Python), you will design, build, and optimize robust data pipelines to support enterprise-scale analytics. You will drive the development of scalable streaming and batch data processing solutions, ensuring seamless integration and data availability across the modern cloud environment.

What You'll Do:

• Design, implement, and maintain highly scalable batch and streaming data pipelines.
• Architect and optimize robust ETL/ELT workflows utilizing cloud-native services and orchestrators.
• Develop and optimize high-performance data models tailored for downstream analytical use cases.
• Collaborate with product and engineering teams to integrate diverse datasets and establish data quality standards.
• Monitor, troubleshoot, and continuously improve pipeline performance to guarantee efficiency and reliability.

What we are looking for:

• 5+ years of experience in Data Engineering, Software Engineering, or a related field.
• Strong hands-on experience with Python and GCP services like BigQuery, Dataflow, and Pub/Sub.
• Proven expertise in designing streaming data pipelines and robust ETL/ELT workflows.
• Solid understanding of workflow orchestration with Apache Airflow or Cloud Composer and data modeling for analytics.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.