Remote Big Data Platform Engineer - High-Performance Queries

BairesDev; Colombia; Presencial; COP 381.667.000 - 572.501.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

100% remote work

Pay in USD or local currency

Hardware provided

Flexible hours

Paid parental leaves

Multinational team

Descripción de la vacante

BairesDev is seeking a Big Data Platform Engineer to lead core development and optimization of high-performance query engines. You will bridge data storage formats with efficient execution to support large-scale analytics, collaborating with global teams.

The role requires 4+ years in software or data engineering and strong Java or C++ skills, with experience in columnar formats and vectorized execution. Remote work is 100% possible, with USD or local currency payments offered.

Formación

• 4+ years of software/data engineering, or systems programming.
• Proven experience developing and optimizing query engine internals (planners/optimizers).
• Advanced proficiency in Java or C++ for high-performance systems.
• Deep understanding of columnar formats such as Parquet and Iceberg.
• Hands-on with vectorized execution and columnar engines.
• Fluency in English.

Responsabilidades

• Design and implement advanced query planners and cost-based optimizers to streamline data retrieval.
• Develop high-performance execution engines using Java or C++ for massive distributed datasets.
• Optimize data processing with vectorized execution and columnar techniques.
• Integrate and customize Calcite or Spark Catalyst to improve performance.
• Ensure interoperability by supporting Parquet and Iceberg formats.
• Collaborate with infrastructure teams to tune engine internals for cloud-native hardware.

Conocimientos

Java

C++

Query planning

Vectorized execution

Columnar formats

English proficiency

Herramientas

Apache Calcite

Spark Catalyst

Parquet

Iceberg

Descripción del empleo

BairesDev is seeking a Big Data Platform Engineer to lead core development and optimization of high-performance query engines. You will bridge data storage formats with efficient execution to support large-scale analytics, collaborating with global teams.

The role requires 4+ years in software or data engineering and strong Java or C++ skills, with experience in columnar formats and vectorized execution. Remote work is 100% possible, with USD or local currency payments offered.