Engineer (Big Data Platform) - Remote work | REF#308675

BairesDev; United States; Remote; MXN 2,048,000 - 2,980,000; Full time

Benefits offered by this job

100% remote work

Competitive USD compensation

Home-office setup provided

Flexible hours

Job summary

BairesDev is seeking an Engineer (Big Data Platform) to join our fully remote global team. This role focuses on building and optimizing high‑performance data engines with Java or C++, handling massive distributed datasets.

You will design query planners, implement vectorized execution, and work with Apache Calcite or Spark Catalyst while ensuring Parquet and Iceberg formats are supported. English proficiency is essential.

Qualifications

• 4+ years of experience in Software Engineering, Data Engineering, or Systems Programming.
• Proven expertise in developing and optimizing query engine internals, including query planners and optimizers.
• Advanced proficiency in Java or C++ for high-performance systems development.
• Deep understanding of columnar data formats such as Parquet and Iceberg.
• Hands-on experience with vectorized execution and columnar execution engines.
• Advanced proficiency in English.

Responsibilities

• Design and implement advanced query planners and cost-based optimizers.
• Develop high-performance execution engines in Java or C++ for large datasets.
• Optimize data processing with vectorized and columnar techniques.
• Integrate Calcite or Spark Catalyst to improve system performance.
• Ensure interoperability with Parquet and Iceberg columnar formats.
• Collaborate with infra teams to tune engine internals for cloud hardware.

Skills

Java

C++

Query planning

Query optimization

Vectorized execution

Columnar formats

Parquet

Iceberg

Distributed systems

English

Tools

Apache Calcite

Spark Catalyst

Job description

At BairesDev®, we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley.

Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works remotely on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Engineer (Big Data Platform) at BairesDev

What You'll Do

• Design and implement advanced query planners and cost-based optimizers to streamline data retrieval.
• Develop high-performance execution engines using Java or C++ to handle massive distributed datasets.
• Optimize data processing efficiency by implementing vectorized execution and columnar data techniques.
• Improve system performance through the integration and customization of technologies like Apache Calcite or Spark Catalyst.
• Ensure seamless data interoperability by managing and evolving support for columnar formats like Parquet and Iceberg.
• Collaborate with infrastructure teams to tune execution engine internals for modern cloud-native hardware.

What We Are Looking For

• 4+ years of experience in Software Engineering, Data Engineering, or Systems Programming.
• Proven expertise in developing and optimizing query engine internals, including query planners and optimizers.
• Advanced proficiency in Java or C++ for high-performance systems development.
• Deep understanding of columnar data formats such as Parquet and Iceberg.
• Hands-on experience with vectorized execution and columnar execution engines.
• Advanced proficiency in English.

How we do make your work (and your life) easier:

• 100% remote work (from anywhere).
• Excellent compensation in USD or your local currency if preferred
• Hardware and software setup for you to work from home.
• Flexible hours: create your own schedule.
• Paid parental leaves, vacations, and national holidays.
• Innovative and multicultural work environment: collaborate and learn from the global Top 1% of talent.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!