Data Engineer - Remote Work

BairesDev; Antioquia; Remote; COP 356,033,000 - 453,133,000; Full time

Benefits offered by this job

Remote work

Competitive pay in USD

Home office setup

Job summary

BairesDev is seeking a Data Engineer to work with a modern, cloud-native data stack to solve large-scale data challenges that influence global decision-making. You will own data solutions end-to-end, from design to production, handling distributed processing, schema evolution, and real-time data flows.

You will design scalable pipelines, manage Delta Lake tables, and write clean Python code for ETL. This role offers 100% remote work and competitive compensation in USD or local currency depending

Qualifications

• 5+ years of total experience in Data Engineering.
• 3+ years of experience with AWS Glue or Databricks.
• 3+ years of experience with Spark.
• 2+ years of experience with Delta Lake.
• 5+ years of experience with Python for ETL and automation.
• Advanced proficiency in English.

Responsibilities

• Design and implement scalable and secure data pipelines using AWS Glue or Databricks.
• Develop and optimize distributed processes in Apache Spark for large volumes of data.
• Manage and maintain Delta Lake tables, ensuring integrity, versioning, and schema evolution.
• Write and maintain clean, modular Python code for ETL and automation.
• Collaborate with cross-functional teams to translate business needs into reliable data solutions.

Skills

Python

ETL design

Data pipelines

Observability

English

Education

Bachelor's degree in Computer Science or related field

Tools

AWS Glue

Databricks

Apache Spark

Delta Lake

SQL

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Data Engineer at BairesDev

In this role, you'll work with a modern, cloud-native data stack to solve complex, large-scale data challenges that directly influence global decision-making. Building and optimizing data pipelines, you'll power how thousands of users access and leverage high-quality data across the organization. This is your opportunity to take end-to-end ownership of data solutions, from design to production, while tackling challenging problems like distributed processing, schema evolution, and real-time data flows.

What You'll Do:

• Design and implement scalable and secure data pipelines using AWS Glue or Databricks.
• Develop and optimize distributed processes in Apache Spark for large volumes of data.
• Manage and maintain Delta Lake tables, ensuring integrity, versioning, and schema evolution.
• Write and maintain clean, modular Python code for ETL and automation.
• Collaborate with cross-functional teams to translate business needs into reliable data solutions.

What we are looking for:

• 5+ years of total experience in Data Engineering.
• 3+ years of experience with AWS Glue or Databricks.
• 3+ years of experience with Spark.
• 2+ years of experience with Delta Lake.
• 5+ years of experience with Python for ETL and automation.
• Familiarity with monitoring, observability, and alerting in data pipelines.
• Advanced proficiency in English.

Nice to have:

• Experience with AWS.
• Familiarity with DataOps and DevOps workflows.
• Experience working with data cataloging and lineage tracking tools.
• Knowledge of SQL performance optimization.
• Exposure to event-driven architectures.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.