Remote Apache Hudi Engineer - Real-Time Data Lakehouse

BairesDev; Peru (IL); On-site; USD 120,000 - 180,000; Full time

Job summary

BairesDev is seeking a Software Engineer specializing in Apache Hudi to design and manage large-scale incremental data processing. You will build and optimize data pipelines, ensure ACID transactions, and enable near real-time analytics across distributed systems.

This fully remote role offers a chance to work with top-tier teams and global clients. The ideal candidate has 4+ years in software or data engineering, strong Hudi experience, and excellent English.

Qualifications

• 4+ years of experience in Software Engineering or Data Engineering.
• Proven expertise in building and optimizing incremental data processing pipelines using Apache Hudi.
• Hands-on experience managing upserts, deletes, and streaming ingestion into data lake storage.
• Deep understanding of data lakehouse architectures and distributed systems.
• Advanced proficiency in English.

Responsibilities

• Design, implement, and manage Apache Hudi tables to support large-scale incremental data processing.
• Develop efficient data pipelines that handle high-frequency upserts, deletes, and CDC.
• Optimize storage formats and indexing to improve query performance and reduce latency on the data lake.
• Implement ACID transactions and schema evolution to maintain data consistency across distributed systems.
• Collaborate with data engineering teams to integrate Hudi with streaming and batch processing engines.
• Monitor and tune background table services, including compaction and clustering, for optimal resource utilization.

Skills

Incremental data processing

Data pipelines

Distributed systems

English proficiency

Tools

Apache Hudi

Job description

BairesDev is seeking a Software Engineer specializing in Apache Hudi to design and manage large-scale incremental data processing. You will build and optimize data pipelines, ensure ACID transactions, and enable near real-time analytics across distributed systems.

This fully remote role offers a chance to work with top-tier teams and global clients. The ideal candidate has 4+ years in software or data engineering, strong Hudi experience, and excellent English.