AWS Data Engineer: Scalable ETL Pipelines & Observability

BairesDev; Región Metropolitana de Santiago; Remote; CLP 88,063,000 - 127,202,000; Full time

Job summary

At BairesDev, we are seeking an AWS Data Engineer to design and build scalable ETL/ELT pipelines on AWS, utilizing Glue and Redshift to move and transform data efficiently at scale. You will apply strong data governance and observability practices to keep pipelines trustworthy as they grow.

You will implement data cataloging with Collibra or similar tools, perform data QA, and set up monitoring across data pipelines.

Qualifications

• 5+ years of experience in data engineering.
• Experience with ETL/ELT development.
• Hands-on experience with AWS, including Glue and Redshift.
• Experience with data cataloging using Collibra or similar tools.
• Proficiency in Python.
• Experience with observability and monitoring for data pipelines.
• Background in data QA.
• Advanced proficiency in English.

Responsibilities

• Build and maintain ETL/ELT pipelines on AWS using Glue and Redshift.
• Implement data cataloging practices to ensure data assets are discoverable and well-governed.
• Set up observability and monitoring across AWS-based data pipelines.
• Conduct data QA to ensure accuracy and reliability of data assets.

Skills

ETL/ELT development

Python

Data QA

Observability

Advanced English

Tools

AWS Glue

Redshift

Collibra

Job description

At BairesDev, we are seeking an AWS Data Engineer to design and build scalable ETL/ELT pipelines on AWS, utilizing Glue and Redshift to move and transform data efficiently at scale. You will apply strong data governance and observability practices to keep pipelines trustworthy as they grow.

You will implement data cataloging with Collibra or similar tools, perform data QA, and set up monitoring across data pipelines.