Apache Hudi Data Engineer – Real-Time Lakehouse

BairesDev; Chile; Presencial; CLP 82.267.000 - 137.112.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote work (100%))/Worldwide

USD salary or local currency

Home office setup

Flexible hours

Parental leave

Mentorship and growth

Descripción de la vacante

BairesDev is seeking a Software Engineer specializing in Apache Hudi to work on incremental data processing for data lakes, ensuring high performance and data integrity. You will design and optimize pipelines and collaborate with global teams in a fully remote setup.

Responsibilities include implementing ACID transactions, schema evolution, and integration with streaming and batch engines. Strong English skills are required.

Formación

• 4+ years of software/data engineering experience.
• Proven experience building incremental data processing with Apache Hudi.
• Experience with upserts, deletes, and CDC in data lakes.
• Deep knowledge of data lakehouse architectures and distributed systems.
• High proficiency in English.

Responsabilidades

• Design, implement, and manage Apache Hudi tables for large-scale incremental processing.
• Develop data pipelines handling high-frequency upserts, deletes, and CDC.
• Optimize storage formats and indexing to improve query performance and reduce latency.
• Implement ACID transactions and schema evolution for distributed systems.
• Collaborate with data engineering teams to integrate Hudi with streaming/batch engines.
• Monitor and tune background table services such as compaction and clustering.

Conocimientos

Apache Hudi

Incremental data processing

Data lakehouse

Distributed systems

English proficiency

Herramientas

Hudi pipelines

Descripción del empleo

BairesDev is seeking a Software Engineer specializing in Apache Hudi to work on incremental data processing for data lakes, ensuring high performance and data integrity. You will design and optimize pipelines and collaborate with global teams in a fully remote setup.

Responsibilities include implementing ACID transactions, schema evolution, and integration with streaming and batch engines. Strong English skills are required.