Senior Data Engineer - Remote, Flex Hours, Spark&Delta Lake

BairesDev; Bogotá ciudad; Remote; COP 288,610,000 - 416,880,000; Full time

Benefits offered by this job

100% remote work

Job summary

BairesDev is seeking a Data Engineer to design and build scalable data pipelines using a modern cloud-native stack that powers thousands of users with high-quality data across the organization.

You will own end-to-end data solutions from design to production, working with AWS Glue, Databricks, Spark, and Delta Lake while collaborating with cross-functional teams in a remote, global environment.

Qualifications

• 5+ years of total experience in Data Engineering.
• 3+ years with AWS Glue or Databricks.
• 3+ years with Spark.
• 2+ years with Delta Lake.
• 5+ years of Python for ETL and automation.
• Familiarity with monitoring, observability, and alerting in data pipelines.
• Advanced proficiency in English.

Responsibilities

• Design and build scalable, secure data pipelines in the cloud.
• Develop and optimize distributed data processing with Spark.
• Maintain Delta Lake tables, ensuring schema evolution and integrity.
• Write clean Python code for ETL and automation tasks.
• Collaborate with cross-functional teams to translate business needs into data solutions.

Skills

Data Engineering

Python

English

Observability

Education

Tools

AWS Glue

Databricks

Apache Spark

Delta Lake

Job description

BairesDev is seeking a Data Engineer to design and build scalable data pipelines using a modern cloud-native stack that powers thousands of users with high-quality data across the organization.

You will own end-to-end data solutions from design to production, working with AWS Glue, Databricks, Spark, and Delta Lake while collaborating with cross-functional teams in a remote, global environment.