Senior Apache Spark Committer — Remote, Flexible Hours

BairesDev; Mexico; On-site; PHP 7,299,000 - 10,949,000; Full time

Benefits offered by this job

Remote work

Competitive USD pay

Hardware provided for home office

Flexible hours

Paid leave and holidays

Global team collaboration

Job summary

BairesDev is hiring an Apache Spark Committer for a 100% remote role. You will contribute to the upstream Spark codebase, focusing on query planners, Catalyst optimization, and high-performance execution paths.

The position requires 4+ years in software engineering with big data internals, deep Java or C++ expertise, and hands-on work with Parquet or Iceberg. Excellent English and global collaboration are essential.

Qualifications

• 4+ years of experience in Software Engineering with a focus on systems programming or big data internals.
• Proven expertise in contributing to the Apache Spark codebase or other high-performance query engines.
• Advanced proficiency in Java or C++ and deep understanding of query engine internals like Spark Catalyst.
• Hands-on experience with columnar storage formats such as Parquet or Iceberg and execution engines.
• Strong background in designing query planners, optimizers, and vectorized execution paths.
• Advanced proficiency in English.

Responsibilities

• Contribute high-quality code to core Spark components, specifically focusing on query planners and the Catalyst optimizer.
• Perform rigorous code reviews for community pull requests to ensure maintainability, documentation quality, and API stability.
• Design and implement advanced vectorized execution paths and columnar processing features to enhance engine throughput.
• Collaborate with the Apache Software Foundation and global maintainers to define the technical roadmap for Spark's distributed computing engine.
• Monitor project health by resolving critical bugs and identifying performance bottlenecks in large-scale data processing workflows.
• Mentor new contributors and participate in community governance, including voting on releases and major architectural proposals.

Skills

Java

C++

Spark

Query planners

Catalyst

Parquet

Iceberg

English

Tools

Parquet

Iceberg

Job description

BairesDev is hiring an Apache Spark Committer for a 100% remote role. You will contribute to the upstream Spark codebase, focusing on query planners, Catalyst optimization, and high-performance execution paths.

The position requires 4+ years in software engineering with big data internals, deep Java or C++ expertise, and hands-on work with Parquet or Iceberg. Excellent English and global collaboration are essential.