Senior Data Engineer - Cloud Data Pipelines & Real-Time

BairesDev; Bogotá; Remote; COP 297,138,000 - 495,229,000; Full time

Benefits offered by this job

100% remote

USD or local currency compensation

Home office setup

Flexible hours

Parental leave & holidays

Global Top 1% talent collaboration

Mentorship & growth

Job summary

BairesDev is seeking a Data Engineer to design and implement scalable data pipelines using a cloud-native stack. You will own end-to-end data solutions, from design to production, leveraging AWS Glue or Databricks, Spark, and Delta Lake to support global decision-making.

Join a 100% remote team that values mentorship and growth, collaborating with the world’s top 1% of tech talent while delivering high-quality data solutions across the organization.

Qualifications

• 5+ years of total experience in Data Engineering.
• 3+ years of experience with AWS Glue or Databricks.
• 3+ years of experience with Spark.
• 2+ years of experience with Delta Lake.
• 5+ years of experience with Python for ETL and automation.
• Familiarity with monitoring, observability, and alerting in data pipelines.
• Cloud experience.
• Advanced proficiency in English.

Responsibilities

• Design and implement scalable and secure data pipelines using AWS Glue or Databricks.
• Develop and optimize distributed processes in Apache Spark for large volumes of data.
• Manage and maintain Delta Lake tables, ensuring integrity, versioning, and schema evolution.
• Write and maintain clean, modular Python code for ETL and automation.
• Collaborate with cross-functional teams to translate business needs into reliable data solutions.

Skills

Data pipelines

Spark

Python

Delta Lake

AWS Glue / Databricks

ETL automation

Observability

Cloud experience

English proficiency

Tools

AWS Glue

Databricks

Apache Spark

Delta Lake

Python

Job description

BairesDev is seeking a Data Engineer to design and implement scalable data pipelines using a cloud-native stack. You will own end-to-end data solutions, from design to production, leveraging AWS Glue or Databricks, Spark, and Delta Lake to support global decision-making.

Join a 100% remote team that values mentorship and growth, collaborating with the world’s top 1% of tech talent while delivering high-quality data solutions across the organization.