Senior AWS Data Engineer - Remote Work | REF#305193

BairesDev; Montes de María; Remote; COP 384,813,000 - 577,219,000; Full time

Benefits offered by this job

100% remote work

USD or local currency compensation

Hardware & software provided

Flexible hours

Paid parental leave

Diverse growth opportunities

Job summary

BairesDev is seeking a Senior AWS Data Engineer to re-engineer an existing ingestion and lakehouse platform and redesign retention, compaction, and recovery for automated restores. This role offers 100% remote work and opportunities to tackle production-scale challenges across Lambda, Glue, EventBridge, and Step Functions.

You will work with Apache Iceberg tables and Kafka on MSK, designing automated recovery, retention, and write-audit-publish patterns.

Qualifications

• 5+ years of data engineering experience with AWS.
• Strong experience managing Apache Iceberg tables.
• Experience with AWS Glue ETL.
• Proficiency in Python.
• Experience with Kafka (MSK).
• Strong code-reading and re-engineering skills for existing systems.

Responsibilities

• Read and re-engineer existing ingestion and lakehouse code across Lambda, Glue, EventBridge, and Step Functions.
• Manage Apache Iceberg tables in the Gold zone, including retention and compaction strategy.
• Redesign recovery processes to automate restores that were previously manual.
• Introduce write-audit-publish patterns to prevent bad writes from landing silently.
• Work with Kafka on MSK for event processing across the pipeline.

Skills

Python

AWS

Kafka

Apache Iceberg

Glue ETL

Lambda

EventBridge/Step Functions

MSK

Tools

AWS Glue

Apache Iceberg

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Senior AWS Data Engineer at BairesDev

In this role, you'll re-engineer an existing ingestion and lakehouse platform, redesigning retention, compaction, and recovery so restores are automated rather than manual. This is your opportunity to bring strong code-archaeology instincts to a real production challenge, introducing publish gates and automated recovery.

What You'll Do

• Read and re-engineer existing ingestion and lakehouse code across Lambda, Glue, EventBridge, and Step Functions.
• Manage Apache Iceberg tables in the Gold zone, including retention and compaction strategy.
• Redesign recovery processes to automate restores that were previously manual.
• Introduce write-audit-publish patterns to prevent bad writes from landing silently.
• Work with Kafka on MSK for event processing across the pipeline.

What We Are Looking For

• 5+ years of experience in data engineering with AWS.
• Strong experience with Apache Iceberg table management.
• Experience with AWS Glue ETL.
• Proficiency in Python.
• Experience with Kafka.
• Strong code-archaeology instincts, with proven experience reading and re-engineering existing systems rather than building greenfield.
• Advanced proficiency in English.

How we do make your work (and your life) easier

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!