Delta Lake Data Engineer — Remote, Flexible Hours & Growth

BairesDev; Mexico; On-site; PHP 7,299,000 - 10,949,000; Full time

Benefits offered by this job

Remote work

USD compensation

Home office setup

Flexible hours

Parental leave

Mentorship & growth

Job summary

BairesDev is seeking a Software Engineer specializing in Delta Lake to design scalable data lake architectures with ACID transactions, time travel and schema evolution. You will work with Delta Lake, Apache Spark and Parquet-based storage.

Responsibilities include building robust ETL/ELT pipelines, optimizing storage and ensuring data reliability at scale while collaborating with global data teams. This 100% remote role offers USD compensation, home-office setup and flexible hours.

Qualifications

• 4+ years of experience in Software Engineering, Data Engineering, or Data Lakehouse technologies.
• Proven expertise with Delta Lake to ensure ACID transactions.
• Hands-on experience with Spark and Databricks for large-scale data processing and optimization.
• Deep understanding of Parquet formats, time travel, and schema evolution.

Responsibilities

• Design and implement scalable data lake architectures using Delta Lake and Apache Spark.
• Enable reliable data processing by managing ACID transactions and ensuring data consistency.
• Optimize storage performance through indexing, partitioning and vacuuming in Databricks environments.
• Develop and maintain ETL/ELT pipelines with schema evolution and time travel for historical data analysis.
• Collaborate with data teams to define storage standards and metadata management using Parquet-based formats.

Skills

Delta Lake

Apache Spark

Databricks

Parquet

Tools

Databricks

Parquet formats

Job description

BairesDev is seeking a Software Engineer specializing in Delta Lake to design scalable data lake architectures with ACID transactions, time travel and schema evolution. You will work with Delta Lake, Apache Spark and Parquet-based storage.

Responsibilities include building robust ETL/ELT pipelines, optimizing storage and ensuring data reliability at scale while collaborating with global data teams. This 100% remote role offers USD compensation, home-office setup and flexible hours.