Staff Apache Iceberg Engineer | REF#308031

BairesDev; Brasil; Remote; BRL 767,000 - 1,041,000; Full time

Benefits offered by this job

Remote work

Global team

Job summary

BairesDev is seeking a Staff Apache Iceberg Engineer to lead the design and optimization of distributed table formats and metadata management. You will contribute to Apache Iceberg and related ecosystem projects (Spark, Flink, Hive), focusing on scalable architecture, performance tuning, and core metadata improvements.

Join a global team to drive advanced data systems, collaborate with engineers on integration, and push open source contributions.

Qualifications

• 10+ years of software development experience.
• Expertise in distributed data systems and Iceberg architecture.
• Experience with Spark, Flink or Hive integration.
• Strong Java and optional Scala or Python skills.
• Proven contributor to Apache open-source projects.
• Advanced English proficiency.

Responsibilities

• Contribute to Apache Iceberg and related open source projects as a core contributor.
• Design and optimize table formats, snapshots, partitioning, and metadata management.
• Drive performance tuning for large-scale tables and incremental operations.
• Lead integration with Spark, Flink, and Hive for batch and streaming workloads.
• Collaborate with engineering teams on technical solutions and system integration.

Skills

Distributed computing

Apache Iceberg

Java

Scala/Python

Performance tuning

Open source contribution

English proficiency

Job description

At BairesDev® we've been leading the way in technology projects for over 15 years. We deliver cutting-edge solutions to giants like Google and the most innovative startups in Silicon Valley. Our diverse 4,000+ team, composed of the world's Top 1% of tech talent, works on roles that drive significant impact worldwide.

When you apply for this position, you're taking the first step in a process that goes beyond the ordinary. We aim to align your passions and skills with our vacancies, setting you on a path to exceptional career development and success.

Staff Apache Iceberg Engineer at BairesDev

We are seeking a Staff Apache Iceberg Engineer to lead the design and optimization of distributed table formats and metadata management systems. You'll contribute to Apache Iceberg and related ecosystem projects (Spark, Flink, Hive), focusing on scalable architecture, performance tuning, and core metadata improvements.

What You'll Do

• Contribute actively to Apache Iceberg and related open source projects as a core contributor.
• Design and optimize table formats, snapshots, partitioning, and metadata management.
• Drive performance tuning initiatives for large-scale tables and incremental operations.
• Lead integration improvements with Spark, Flink, and Hive for batch and streaming workloads.
• Collaborate with engineering teams on technical solutions and system integration.

What We Are Looking For

• 10+ years of experience in software development.
• Strong expertise in distributed computing and large-scale data systems.
• Deep understanding of Apache Iceberg table architecture, schema evolution, snapshots, partitioning, and incremental reads.
• Proficiency in Java (primary), and Scala or Python for ecosystem integrations.
• Proven experience in performance tuning and optimization of metadata and table operations.
• Core contributions to Apache open source projects (Iceberg, Spark, Hive, Flink, or similar).
• Advanced level of English.

How We Make Your Work (and Your Life) Easier

• Excellent compensation in USD or your local currency if preferred.
• Paid parental leave, vacation, & national holidays.
• Innovative and multicultural work environment.
• Collaborate and learn from the global Top 1% of talent in each area.
• Supportive environment with mentorship, promotions, skill development, and diverse growth opportunities.

Join a global team where your unique talents can truly thrive and make a significant impact!