Remote Data Engineer — Cloud Pipelines & Spark

BairesDev; Valle del Cauca; Remote; COP 291,290,000 - 420,753,000; Full time

Benefits offered by this job

Remote work

Competitive compensation in USD

Home office setup

Flexible hours

Paid parental leave

Mentorship & growth

Job summary

BairesDev is seeking a Data Engineer to design, build, and optimize cloud-native data pipelines that empower decision-making across global teams. You will own data solutions end-to-end, from design to production, tackling distributed processing, schema evolution, and real-time data flows.

You'll work with AWS Glue or Databricks, Spark, Delta Lake, and Python to deliver scalable, secure data platforms. Remote work, competitive USD compensation, and a supportive, multicultural environment are

Qualifications

• 5+ years of total experience in Data Engineering.
• 3+ years of experience with AWS Glue or Databricks.
• 3+ years of experience with Spark.
• 2+ years of experience with Delta Lake.
• 5+ years of experience with Python for ETL and automation.
• Familiarity with monitoring, observability, and alerting in data pipelines.
• Cloud experience.
• Advanced proficiency in English.

Responsibilities

• Design and implement scalable and secure data pipelines using AWS Glue or Databricks.
• Develop and optimize distributed processes in Apache Spark for large volumes of data.
• Manage and maintain Delta Lake tables, ensuring integrity, versioning, and schema evolution.
• Write and maintain clean, modular Python code for ETL and automation.
• Collaborate with cross-functional teams to translate business needs into reliable data solutions.

Skills

Data Engineering

AWS Glue

Databricks

Apache Spark

Delta Lake

Python ETL

Observability

Cloud experience

English proficiency

Tools

AWS Glue

Databricks

Apache Spark

Delta Lake

Python

Job description

BairesDev is seeking a Data Engineer to design, build, and optimize cloud-native data pipelines that empower decision-making across global teams. You will own data solutions end-to-end, from design to production, tackling distributed processing, schema evolution, and real-time data flows.

You'll work with AWS Glue or Databricks, Spark, Delta Lake, and Python to deliver scalable, secure data platforms. Remote work, competitive USD compensation, and a supportive, multicultural environment are